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Publishers’ Announcement . 
The Journal must get along on less paper 


The War Production Board has ordered publishers to reduce 
their consumption of paper over 1942 figures. Accordingly, 
effective with this number and for the ‘duration’ there will be 
one signature less per issue. 


Also there is a slight change in the trimmed size of the 
magazine. This change enables us to use a standard size stock 
instead of the former odd size which had to be run by the mill 
for us specially. So as to provide adequate margins the width 
of the type page is being reduced fractionally. Unavoidably, 
the two widths appear in this number, but future issues will 
be uniform in this respect. 
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STUDENT RATING OF COLLEGIATE EXPECTATIONS 
STANLEY S. MARZOLF 


Assistant Professor of Psychology, Illinois State Normal University, 
Normal, Illinois 


PROBLEM 


It is the purpose of this study to see how students will evaluate 
verbal statements of possible outcomes of a four-year teacher educa- 
tion course, and to determine whether there is any difference in the 
evaluation of the statements by freshmen and upper classmen, both 
as to the median value and as to variability. 


METHOD 


Sixty-one statements of what might be the outcome of a teachers 
college course were compiled. The statements were based on sugges- 
tions from colleagues, and a list of motives for coming to college pre- 
pared by Valentine and others (*, p. 82). An effort was made to 
include statements representing all degrees of desirability of outcome, 
though of course the criterion of desirability was the investigator’s 
judgment. The statements were arranged in random order according 
to the method and table provided by Lindquist (*, p. 25). Instruc- 
tions to the students were as follows: 


The following sixty-one statements describe what students might say they 
expect to have achieved when they graduate from Illinois State Normal 
University. You are to rate each statement on the basis of how worth while 
you think such an expectation is as the sole outcome of such a college course. 


Use the following scale as a guide: 


1 2 3 4 5 6 7 8 9 10 11 
Least Neither good Most 
worth while nor bad worth while 
1 
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Try to rate each statement independently, keeping in mind the nature of 
the extremes and the middle of the above scale as a guide. Thus, if you think 
the outcome described by the statement is the most worth while, rank it 11. 
If it is less desirable, give it a lower rank, with a rank of one if you think it is 
the least worth-while aim one could have. 


YOUR PERSONAL EXPECTATION IS NOT INVOLVED IN THIS 
RATING 


The instructions, followed by the sixty-one statements, were mimeo- 
graphed. 

The students who did the rating were one hundred fifty-four fresh- 
men enrolled in general psychology, eighty-three juniors and thirty- 
eight seniors enrolled in a course in Guidance.* The juniors had had 
no teaching experience while the thirty-eight seniors had done, or 
were at the time doing, student-teaching. The ratings were made 
early in the second semester. Ratings from thirty-three faculty 
members were obtained for comparison purposes. These faculty 
members were the portion of those voluntarily in attendance at a 
personnel forum who were willing to make the ratings. Obviously 
the faculty ratings do not constitute a random sample, since it is very 
probable that the most progressive and interested participated. For 
this reason the faculty ratings were not included in the correlations to 
be mentioned later. 

The ratings of each item by each group were tabulated and the 
medians determined according to the procedures described by Thur- 
stone.4 The Q values were also found for each item for each of the 
three classes and the faculty. 

The correlation between the ratings and the class rank was com- 
puted for each item in order to determine if there was any relationship 
between the way in which the items were rated and the degree of 
educational sophistication of the raters. Correlation was determined 
by use of epsilon, Kelley’s eta corrected for bias. The formula and 
the method of computation described by Peters and VanVoorhis 
(5, pp. 319-325) were used. This measure of association is especially 
suitable for this study since it permits the discovery of relationships 
that are curvilinear. The method does not preclude the possibility 
of rectilinear relationship and takes into account the probably 
non-linear scale of educational sophistication as represented by 





* The author is indebted to Drs. Flora Wilder and Victor Houston for their 
courtesy in administering these item ratings in their classes. 
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freshmen, juniors without teaching experience, and seniors with 
teaching experience. (?, footnote, p. 288.) Furthermore, this method 
allows for the low values of N in the separate classes by using esti- 
mated population variance rather than sample variance. The nature 
of the relation can be seen by inspecting the medians; epsilon shows 
the strength of the relation. 

The method of determining the significance of epsilon proposed by 
Peters and VanVoorhis (5, p. 324) has been applied to these data. 
The value of epsilon square which must be equalled or exceeded for 
the relationship to be significant at the five- and one-per-cent levels 
was determined from the Peters and VanVoorhis tables by the graphic 
method. These values, when k is two and N is 275, were found to be 
.014 and 0.25, respectively. (Epsilon, .12 and .16, respectively.) 
In discussing the data in the tables, bear in mind that the values are 
those of epsilon, while the significance of these values is determined 
from the corresponding epsilon square values, not shown in the tables. 

To answer the question whether a change in variability in ratings 
corresponds to a change in class rank, frequency distributions of the 
Q values of the sixty-one items for each of the three classes were made. 


The epsilon technique was then applied. 


RESULTS 


The statement ‘‘I shall have a comprehensive knowledge of my 
major field and the principles of teaching’’ was considered by freshmen 
oresent the most worth-while outcome of four years in this school. 
inis statement also ranked first for juniors and was in second place 
for seniors. The median value of the ratings by the faculty gave it a 
rank of 1644. The seniors and the faculty gave first place to the 
statement ‘‘I shall be able to help young people to develop their 
greatest usefulness.’’ This statement was in third place for both 
freshmen and juniors. 

For freshmen the least worth-while statement of expected out- 
come was “I shall have pleasantly disposed of four years of my life.”’ 
This statement ranked 58th, 57th, and 54th for juniors, seniors, and 
faculty, respectively. Juniors and faculty members considered, ‘I 
shall be on the road to fame”’ as the least desirable statement. This 
had a rank of 591% for seniors and of 60 for freshmen. 

The rating of the statement ‘‘I shall be in a position to demand 
of the world a good living” shows the most significant change when 
freshmen, juniors, and seniors are compared. It has a rank of 4914 
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for freshmen, 52 for juniors, and 53 for seniors. While these differ- 
ences are not large, the correlation (.65) is markedly significant. 

The second most significant relationship between rating and class 
rank is shown by the statement ‘‘I shall have developed a philosophy 
of life’’ which has a rank of 3244, 11, and 4% for freshmen, juniors, and 
seniors, respectively. 

In all, fourteen items are significant at the five-per-cent level and 
of these, nine are significant at the one-per-cent level. 

This brief preliminary survey of the results will now be amplified, 
and the results relevant to the question of change in variability with 
class rank will be presented. 


RELATIVE VALUES AND CORRELATIONS WITH CLASS RANK 


In order to simplify the consideration of the ratings given the 
statements, seven categories have been arbitrarily devised and the 
statements grouped accordingly. The data showing the rank and 
median value of a statement and correlation of the rating with class 
rank are given in each of these tables for items included in a given 
category. 


TaBLE I.—Rank, MEDIAN, AND CORRELATION FOR THE 
ALTRUISTIC ITEMS 














Rank and median 
Statement Epsilon 

F | J|S | Fa 

(39) Be fitted foralife of greatest useful-| 3 | 544) 8 | 2 .02 
DS +i oh cabh db anes koe sane ks 9.3) 9.5| 9.3| 9.6 

(1) Be able to help young people to} 3 |3 |1 | 1 . 20T 
develop their greatest usefulness... .| 9.3)10.0|10.2|10.3 

(29) Be in a position to help others....| 5 | 8 [1214] 44%) .00 
9.2) 9.4 8.9) 8.9 

(17) Be more useful to any community | 8144/17 /|2514| 644) .02 
in which I livethanif Ihad notcome| 9.0) 8.9) 8.0] 8.8 

(56) Be a much better citizen than I /2044/1344/14 | 6%) .15* 
otherwise would have been....... 8.3) 9.2) 8.7| 8.8 




















* Significant at the five-per-cent level. 
t Significant at the one-per-cent level. 
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The first category, the altruistic, comprises five items and is 
summarized in Table I. The number to the left of the statement 
indicates the order in which it appeared in the list of statements given 
to the students for rating. The roman figures in the first four columns 
indicate the rank of the statements among all sixty-one statements 
for the freshmen, juniors, seniors, and the faculty. The numbers in 
italics are the medians calculated for each statement for each group. 
The value of epsilon is given in the fifth column. The items are 
arranged in order of value according to the rating by freshmen. The 
full statements in every case began, ‘‘When I graduate I shall .. . ” 
All tables supplying data for the several categories are arranged in 
the same way. 


TaBLE I].—RaNK, MEDIAN, AND CORRELATION FOR THE 
PROFESSIONAL ITEMS 











Rank and median 
Statement Epsilon 
Fi J{|S | Fa 
(3) Have a comprehensive knowledge 
of my major field and the prin-/ 1 1 | 2 |16%) .05 
ciples of teaching................ 9.8110.2| 9.8| 7.7 
(11) Feel well equipped for the teaching | 844) 514/121%4/12 .00 
CR os se i atrbaaeeenes 9.0) 9.5) 8.9 8.1 
(32) Have a good knowledge of the |11%|15%/11 (26 .00 
principles of teaching............ 8.8) 9.1) 9.0) 6.8 
(25) Have a thorough knowledge of my |1344/11 | 6 |16%| .13* 
major teaching field.............. 8.7| 9.3) 9.6| 7.7 
(59) Have the ability to impart sound |16 [134%/15%4/1644) .12* 
0 er 8.5) 9.2| 8.6) 7.7 
(61) Have a certificate and be legally |26 (4114|4214/35 .18f 
qualified to teach................ 7.9) 6.2| 5.8) 6.0 




















* Significant at the five-per-cent level. 
t Significant at the one-per-cent level. 


In the first category the first four statements definitely involve the 
idea of usefulness to others and the fifth statement carries this idea 
by implication. The median ratings for these items are all relatively 
high. Two of them, statements 1 and 56, show significant correlation 
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with class rank. In both of these the trend is toward a high rating, 
and it is continued for the faculty. (Remember that the faculty 
data were not included in the computation of epsilon.) While the 
relative ranks show some large differences, inspection of the median 
values of the items shows only slight differences. 


TaBLE III.—Ranxk, MEDIAN, AND CORRELATION FOR THE CULTURAL 


























ITEMS 
Rank and median 
Statement Epsilon 
F | J|S | Fa 

(55) Be prepared to enter a profession 
in which there is room for inde- 
pendent study and self-improve-| 644 8 |10 |1014) .07 
ROT fe Oe 

(28) Realize how little I know and how |1344/11 | 9 /18 .00 
much there is to know........... 8.7| 9.3| 9.2) 7.6 

(2) Have a broader and larger view of |18 (15441514) 444; .09 

the world in which we live........ 8.4) 9.1) 8.6) 8.9 

(20) Have learned how to appreciate |2014/25 /2514/13 .00 
the finer things of life............ 8.3| 8.0| 8.0| 7.9 

(27) Have the knowledge necessary to |2314|2714/23 (27 .15T 
keep in good health..............| 8.0) 7.8) 8.1) 6.7 

(46) Have obtained a_ considerable |2314'2714/23 |40 .00 
amount of knowledge............ 8.0| 7.8 8.1) 5.4 

(57) Be much more cultured than I now |2814/2214/28 (2314) .00 
6 (ORI, AG AE a eet eae 7.8| 8.4) 7.7) 6.9 

(14) Have gained knowledge wherewith |40 |44 |28 (56 Sw 
to support my present beliefs... .. 6.5) 6.6| 7.7) 0.9 

(23) Feel that I have a rather complete 4114/4114/41 44 .00 
education............. 6.4 6.2) 6.1 3.9 





* Significant at the five-per-cent level. 
t Significant at the one-per-cent level. 


The professional statements are presented in Table II. Statement 
3 has been previously mentioned. Statements 3, 32, and 25 involve 
the relative value of knowledge of subject-matter, knowledge of 
educational principles, and the combination of the two. The com- 
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bination of subject-matter knowledge and knowledge of teaching 
method is rated higher by all groups save the faculty, by whom it is 
rated no higher than subject-matter knowledge. As shown by the 
data for statements 25 and 32, knowledge in a teaching field becomes 
increasingly important and, for seniors, takes precedence over knowl- 
edge of principles of teaching. This may well be the consequence of 
student-teaching wherein failure to know subject-matter is daily 
more apparent than deficiencies in teaching method. 

The statements summarized in Table III have to do with what 
may be called cultural aims. For the most part these aims are rated 
so as to be in the upper half of the ranks. The significant trend in 


TaBLE IV.—RANK, MEDIAN, AND CORRELATION FOR THE SOCIAL 

















ITEMS 
Rank and median 
Statement Epsilon 
Fiji J|S | Fa 
(43) Have gained social skills that will 39 (33 (35 (31 .05 
be generally useful. . eee Cy See LO 
(13) Have had four years of pleasant 48 /48 (4614/48 .00 
RS ss sp 6. 0'e She eres sx ae 5.1} 5.1) 5.4) 2.6 
(48) Have kept in touch with my old {51 (50 (50 (4914) .00 
ESE a cere 4.3) 4.3) 5.0) 2.0 
(30) Have had a good time........... 52 |49 /48 |52%/ .00 

















4.1 4-4 6.2, 1.6 





the value of health knowledge is of special interest. This item stands 
in about the same relative position for the faculty, but the median 
rating is somewhat lower. The large difference between faculty 
and student rating of item 46 should be noted. The relative rank is 
about the same, but the faculty median is much lower. There is 
also a marked difference between the faculty and student rating for 
items 23 and especially 14. In the latter case the nature of the trend 
seems to indicate that the statement is ambiguous, meaning markedly 
different things to the various groups. This in itself may have 
significance, but its meaning is not clear. 

In Table IV the facts concerning the social items are summarized. 
The first statement implies different motivation than do the remaining 
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three. Contrary to what one might expect, judging from student 
behavior, the last three statements are not valued highly. These 
data suggest that for many, if not most, people the immediacy with 
which a motive may be satisfied is a far greater factor in determining 


TaBLE V.—RankK, MEDIAN, AND CORRELATION FOR PERSONAL 
ADJUSTMENT ITEMS 














Rank and median 
Statement Epsilon 
Fi J|S8S |Fa 
Subgroup A: Vocational. 
(24) Have solved the problem of voca- |3514/3044/31 42 .00 
ER I an a 7.1) 7.6) 7.5) 4.7 
(44) Be a better home-maker than if 1/46 (37 (3644/2314) .18* 
not come to school............... 5.7| 7.0) 7.0) 6.9 
(40) Be a better housekeeper than if 1/54 (51 (52 (41 .00 
had not come to school........... 3.5) 3.5) 4.3| 4.8 
Subgroup B: Self-expression. 
(36) Have developed a pleasing per-|15 |19 |20 /2344) .00 
Tr eee Pe 8.6| 8.8) 8.4, 6.9 
(6) Have learned to express myself |30144/33 |18 (37 .07 
Ie RS. 7.5| 7.6| 8.5| 6.7 
(18) Made the most of my native abil- |3044|19 (30 |1914) .00 
EA oi lls ed oe 4 oy We'd ns 7.5) 8.8| 7.6) 7.6 
(41) Have learned to express myself in |3214/3014|3314|29 .00 
Rh cele Ccktna wand ee oes 7.3) 7.6) 7.3) 6.6 
Subgroup C: ideals. 
(38) Have developed higher ambitions| 64/19 | 44/1014) .08 
Ge Me a a ernie ba elk ua oh 9.1) 8.8) 9.6) 8.4 
(34) Have developed a good character..}|10 | 8 | 7 | 8% .09 
8.9 9.4) 9.4) 8.6 
(7) Have gained much from asso-|28144/33 |21 (/39 .00 
ation with trained teachers....... 7.8| 7.5) 8.2) 6.6 
(10) Have developed a philosophy of |32}4/11 | 41%! 81%) .38* 
eA LES 445466 bs eds ka as 7.3) 9.3 9.6) 8.6 
(15) Have learned how to enjoy life..../38 (35 |3334/2314| .11 
6.9 7.4) 7.3| 6.9 
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TABLE V.—Continued 





Rank and median 


Statement Epsilon 
Fi J{|S | Fa 








Subgroup D: Social competency. 
(60) Have learned how better to under-| 3 | 2 | 3 | 3 .20* 

ER i PO rae 9.3)10.1) 9.7| 9.1 
(26) Have made many new friends..... 11%) 4 {18 (33%) .00 
8.8| 9.6) 8.8) 6.1 
(50) Be better able to get along with |18 (2244/18 [1634] .00 


IN < vty a 60s ch cheaneeenes en 8.41 8.4) 8.6) 7.7 

(4) Be much better able to get along|18 (24 (28 (14 .05 
LS. 06s ckheedpeneeean 8.4) 8.1) 7.7) 7.8 

(19) Have learned how to meet compe-|26 /21 (38 (36 .09 
RN ok sts 60:94 b eaaee eee o% 7.9 8.6 6.9 5.8 


(35) Have found my greatest satisfac- 
tion in having met people with |3514/37 |40 (38 .00 
different opinions. . a | 7.1) 7.0) 6.3) 6.6 

(12) Have gained most from participe- 43 48 (4214/43 .00 
tion in extra-curricular activities. .| 6.1/6.0 |5.8 | 4.4 

(31) Have found my greatest satisfac- 
tion in having found people with |44 /4514/45 (45 .00 
Sy SI , a's 5.4.5-0 0 ddan es 6.0) 5.4) &.5| 3.8 

(51) Have found my greatest satisfac- 
tion in having found people with |45 |45144/4644/49l4) .04 
so §.8| 5.4) &.4) 2.0 




















* Significant at the one-per-cent level. 


behavior than is the strength or the motive when it is compared with 
others not so capable of prompt satisfaction. There is not much 
difference in the above statements, when compared by relative rank, 
between the faculty and the students, but the median ratings by the 
faculty are markedly lower, and doubtless significantly so in many 


cases. 

The category “personal adjustment” is a large one, and conse- 
quently has been divided into four subgroups as shown in Table V. 
Statement 44 in the first sub-group shows a significant increase in 
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value with increase in class rank. It is also noteworthy that item 44 
is differentiated from item 40. 

The worthwhileness of developing a pleasing personality is quite 
high for the students but is considered not so great by the faculty. 
Both oral and written expression, while standing about half-way 
relative to other items, have median ratings in the upper half of the 
range, being the neighborhood of 7.5. 

The high value assigned to the development of higher ambitions 
and ideals and the development of good character is conspicuous in 
Subgroup C. The trend shown for statement 10 has been previously 
noted. 

The first statement in Subgroup D shows the greatest relation to 
class rank of any in this group. Statements 4 and 50 are practically 
identical, and yet, though they appeared at opposite ends of the 
original list of statements, there is little difference in the values assigned 
to them. The relatively lower position assigned to extra-curricular 
activities will contradict the expectations of many. Of course, its 
median rating is above average, but only eighteen statements rank 
lower. It is gratifying to note that meeting people with different 
opinions and interests is thought more worth while than meeting people 
with similar opinions and interests. 

Table VI shows the facts concerning the preéminence items. Most 
of these rank low, and a few of them rank lowest of all the statements. 
The first four statements relate to economic preéminence. These 
rank highest of the group and have ratings, as indicated by the 
medians, of seven or eight. ‘The remainder relate to social prestige 
and are all ranked near the low end of the scale. The significant 
relationship shown in statement 8 was discussed above. 

The last category, the extrinsic items, is given the lowest rank of 
all. Statement 37 shows a significant progressive decline but item 
16 shows an equally significant trend of another sort. Apparently 
an appreciation of parental sacrifice and interest becomes more pro- 
nounced as the student nears graduation time. Statement 21 shows a 
significant declining trend. There is rather close agreement with 
faculty ratings for all the items, as far as relative position is con- 
cerned, but the statements with low median ratings for the students 
have even lower median ratings by the faculty. 

In spite of tne fact that the seven categories were determined in 
an a priori, arm-chair fashion, they can be arranged in an order of 
descending value as they have been in this presentation of the results 
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in the tables. There is, it is true, some overlapping, and it is also 
true that the placement of some of the items is questionable. Never- 
theless, the statements assigned the highest value are those expressing 
altruistic aims. Statements describing outcomes definitely related to 


TaBLE VI.—Ranxk, MEDIAN, AND CORRELATION FOR PREEMINENCE 











ITEMS 
Rank and median 
Statement Epsilon 
Fi J|S |Fa 
(22) Be prepared to become financially |22 (29 (32 (32 .00 
IN c's 0's.6 o cachowe ease 8.1| 7.7| 7.4 6.8 
(45) Be able to make a respectable, dig- |26 (26 (23 (21 .00 
I necks ali actat's 6 7.9 7.9) 8.1) 7.8 
(52) Be able to get a good job......... 3544/40 |89 (38314; .00 


7.1| 6.4) 6.6) 6.1 
(54) Be able to make a better living (3514/37 (3614/29 .10 
than if I had not gone to school....| 7.1) 7.0) 7.0) 6.6 
(33) Have a social standing that will 
make me more respected in any |4144/39 (44 (29 .00 


CN. ss 5 ealgd wt OGa a tenon 6.4) 6.6| 5.6| 6.6 
(8) Be in a position to demand of the 4944/52 {53 (51 .65* 
world a good living.............. 4.6| 3.4) 3.8) 1.8 
(49) Be assured of success in life....... 4916\47 |51 (46 .00 


4.6) 6.3) 4.8) 3.6 
(58) Have separated myself from the 5644/57 (5914/5714) .11 

lower classes of society........... 3.1) 2.7| 1.2| 0.8 
(9) Be ready for a “white-collar” job..|59 |60 (58 (5744) .00 
1.6; 1.2| 1.4) 0.8 
(5) Be on the road to fame........... 60 (61 (5914/61 12 
1.2, 0.0| 1.2) 0.0 




















* Significant at the one-per-cent level. 


the teaching profession are second. These are followed by the cul- 
tural, personal adjustment, preéminence, and extrinsic categories. 
As far as the method of this study is valid as an indicator, students 
are not as frivolous or given to inconsequential aims as is generally 
believed. 
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It is possible that the students rated the statements in accordance 
with educational stereotypes. This would account for the fact that 
some of the high-valued items were rated higher by students than by 
the faculty, but, in contrast with these findings, the faculty rated the 
low-valued items lower than did the students. It would seem that if 
stereotyped responses were being made to any great extent, the evi- 


TaBLE VII.—Rank, MEDIAN, AND CORRELATION FOR THE EXTRINSIC 
ITEMS 





Rank and median 
Statement Epsilon 
F | J|S|Fa 








(16) Have pleased my parents......... 47 |53 |49 |47 .17T 
5.41 3.3) 5.1) 3.0 
(21) Have prevented my acquaintances |53  /55144|55 |[5214| .13* 


from saying I couldn’t doit....... 4.0) 2.8) 2.0) 1.6 

(53) Have found a pleasant diversion |55 (54 (54 /|60 .04 
eS ie cee a a oe 3.3| 3.2) 2.8) 0.4 

(37) Found out if college life is as fasci- |56144/5514/61 [59 .17f 
nating as I’ve heard it to be..... 3.1) 2.8) 0.5) 0.6 

(47) Not have to work as hard as if 1/58 (59 (56 (55 .05 
had not gone to school........... 2.5; 1.81 1.7| 1.0 

(42) Have pleasantly disposed of four |61 (58 [57 {54 .08 
ee 1.0) 2.0| 1.6) 1.1 




















* Significant at the five-per-cent level. 
t Significant at the one-per-cent level. 


dence would appear at both ends of the scale. It might be, it is true, 
that the students have one set of stereotypes and the faculty another. 
It is very probable that the values assigned to some of the statements 
are the results of stereotypy, but it does not seem reasonable to 
assume that all, or even many, of the ratings can be accounted for in 
this way. However, this is a matter for further study. 

For students there were more high-rating statements than low- 
rating ones. Many reasons for coming to college seem highly justi- 
fiable. The faculty rated a larger proportion of the statements at the 
low end of the scale. This might be indicative of better discrimina- 
tion, stronger prejudices of an antagonistic sort, or more stereotypy on 
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the part of the faculty. The data do not enable one to select from 
among these possibilities. 

Data for determining the reliability of the medians has not been 
shown in the above tables because to have done so would encumber 
the tables with too much detail. The significance of the trends is, of 
course, dependent upon the reliability of the medians, and the relia- 
bility is thus in some cases indirectly reflected in the epsilon values. 
As further indication of reliability of the medians, a general statement 
can be made. The median Q value for all the groups combined is 1.66, 
with a PE of .025. Using a Q value of 1.66 as typical of all medians, 
the freshman medians would have a PE of approximately .17; the 
juniors, approximately .22; the seniors, approximately .34; and the 
faculty about .35. 

These ratings were not obtained from the same individuals in 
successive years; hence, it is possible that the differences between 
freshmen and seniors may not reflect changed attitudes, but solely 
the effect of selection. Of course, failure to change attitude may be 
a factor in selection, but there also might be some other factor and 
thus change in attitude might be obscured.' 


RELATIVE VARIABILITY BY CLASSES 


The third question of interest in connection with the evaluation of 
these statements is whether there is any change in the variability in 
the ratings which corresponds to class rank of the students. Fre- 
quency distributions of the Q values are shown in Table VIII. Here 
it will be seen that the median Q value decreases in passing from fresh- 
men to juniors, to seniors. However, the Q value of the faculty is 
higher than that of the juniors. The trend for the students is a signifi- 
cant one, for the value of epsilon obtained by correlating Q value with 
class rank is .607—far higher than the minimum necessary for signifi- 
cance at the one-per-cent level of confidence. 

The scatter of the ratings about the median could result from lack 
of agreement about the value of the statements or from lack of agree- 
ment about what the statements mean, or both. The precision of a 
mathematical expression can seldom, if ever, be achieved by a verbal 
statement—some slight ambiguity may exist. Furthermore, state- 
ments which to a person having one level of understanding are unam- 
biguous may be ambiguous to another with greater sophistication or 
understanding. This might explain why the faculty members show 
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TaBLE VIII.—VARIABILITY OF THE RATINGS AND CLass RANK 








Q VALUE FRESHMEN JUNIORS SENIORS Facutty TOTAL 
Te a ee ap ee en oe A silks es 2* 
SS Se ee ee eer eens 1 2 
3.20-3.39.......... a eee BS, . ooo cada ome 3 
- * ). 2 a ee ee en ee 3 
2.80-2.99.......... 2 4 1 2 9 
>, 2 2 Lava pats reat 5 
OSS ea 6 5 6 4 21 
OS ee 2 5 2 1 10 
S| » 5 2 4 6 17 
ee 5 3 5 8 21 
i 14 10 7 13 44 
SS 11 15 13 10 49 
eS. ee 8 6 13 10 37 
SS 2 3 5 5 15 
Ee 2 1 1 4 
SS er Fre ee rei 2 
| 61 61 61 244 
a 1.73 1.64 1.57 1.66 1.66 
Ne . 062 .072 .060 .048 .025 


* One of these was 4.6. 


a higher median Q value than the seniors, although the difference 
shown in the table is not very significant, having a critical ratio of 


only .8. 
CONCLUSIONS 


(1) The statements ‘‘I shall have a comprehensive knowledge of 
my major field and the principles of teaching’”’ and “‘I shall be able 
to help young people to develop their greatest usefulness”’ were given 
the highest ratings by the students and the faculty. The statements 
“‘T shall have pleasantly disposed of four years of my life” and “I 
shall be on the road to fame” were given the lowest ratings. 

(2) Statements representing altruistic outcomes were ranked 
highest, followed by professional, cultural, personal adjustment, pre- 
éminence, and extrinsic aims, in the order given. 

(3) In general, student and faulty ratings did not disagree markedly. 

(4) The students gave a larger proportion of the statements high 
ratings than did the faculty. 
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(5) Judged by the faculty ratings, and by the author’s opinion of 
what the majority of educators would believe, the students have a 
fairly sound opinion of what teacher education should do for them. 

(6) There are some indications of trends in opinion corresponding 
to class rank, but only a few of these trends are statistically significant. 
In each instance, the value of being able to ‘‘ help young people develop 
their greatest usefulness,” “being a better home-maker,” “‘developing 
a philosophy of life” increases with increase in class rank. The 
following decrease in value from freshmen to seniors: “Found out if 
college life is as fascinating as I’ve heard it to be”’ and “have a certifi- 
cate and be legally qualified to teach.’’ A number of other statements 
are higher for freshmen and seniors than juniors, and some are higher 
for juniors than for either freshmen or seniors. 

(7) There is a significant change in variability of rating which 
corresponds with class rank. The median Q value for freshmen is 
1.73; for seniors, 1.57. 


LIMITATIONS OF THE STUDY 


While these results show in a general way that students do know 
why they are in school, it must be remembered that they have reacted 
to verbal statements only. Furthermore, recognizing what one ought 
to do, and believing it strongly enough to act upon it are manifestly 
different things. Competing motives of a more immediate nature 
may be stronger, or the student may be one who finds it difficult to 
work for remote ends. These factors of course have not been taken 
into account. 
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THE McGILL ADULT COMPREHENSION 
EXAMINATION: “VERBAL SITUATION” 
AND “PICTURE ANOMALY” SERIES* 


D. O. HEBB 


Queen’s University 
AND 
N. W. MORTON 


McGill University 


This report describes two tests, verbal and nonverbal, meant for 
use with adults as a supplement to the more abstract problems of 
existing tests (Hebb and Morton’). Both ‘‘ Verbal Situation Series” 
and ‘Picture Anomaly Series” concern an understanding of human 
behavior, and are intended to provide problems of intrinsic adult 
interest; together they comprise the ‘‘ McGill Adult Comprehension 
Examination,”’ but they need not necessarily be used together as a 
single test. Both are culture-loaded; norms are given for two pre- 
dominantly urban populations in the provinces of Quebec and Ontario, 
in Canada; and other norms will be necessary for any markedly 
different population. Our object is not primarily, however, to provide 
a test ready standardized for widely different populations (if such a 
thing is possible), but to provide new material which others may 
rearrange or restandardize to suit themselves. 


TEST DEVELOPMENT 


Both tests were originally designed for clinical research, and some 
preliminary experiments were conducted at the Montreal Neurological 
Institute with the aid of Mr. James Stevenson and Miss Grace Findlay. 
As a result of this work certain criteria of test content were formulated. 
There appeared to be two kinds of item, one a logical problem, the 
other related to social problems which the intelligent adult had already 
worked out for himself. The second type of problem appeared to be 
more interesting and acceptable to most adults, and there were sug- 
gestions that it might be a more valuable supplement to existing tests. 





* Prepared with financial aid from the Montreal Neurological Institute and the 
Cooper Research Fund, McGill University. Acknowledgments are due to the 
stafis of the Neurological Institute, Royal Victoria Hospital and Kingston General 
Hospital and to the Montreal Protestant Employment Bureau for their generous 
help in obtaining volunteer normal control subjects. 
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In the pictures, there was a choice between representation (A) of 
physical impossibilities or absurdities, and (B) of poor human judg- 
ment or social errors; in the verbal items, between (A) what were 
essentially puzzles and (B) the presentation of proverbial human 
problems. In both verbal and nonverbal tests, we have chosen to try 
to get at the understanding of actual human behavior; in the pictures 
by representing not impossibilities, but the improbable or humorous; 
in the verbal test by referring in as plain words as we could find to the 
stock situations of human intercourse. 

One special reason for this procedure was an attempt to find prob- 
lems on which the older subject did as well as the younger, in the 
belief that existing tests tend not to give an adequate account of 
senescent intelligence.' The main object, however, is that already 
referred to—to broaden as much as possible the range of abilities 
sampled by intelligence tests. 

During development the tests were kept on an experimental foot- 
ing, and the criteria described were developed as the result of indi- 
vidually testing more than two hundred public-ward patients in 
general hospitals. More emphasis has been given to finding and 
improving the material than to large standardization groups; use has 
been made of repeated ‘‘standardizations’’ with small groups of 
fifteen to forty subjects, revising the material as soon as the need of 
change appeared. Seven revisions have been made of the pictorial 
material, eleven of the verbal, over a three-year period. In the early 
work with the pictures, the collaboration of Miss Elizabeth Peck was 
chiefly responsible for the development of a satisfactory type of item, 
intentionally cartoon-like and often amusing.* Examples of pictorial 
items are given in Fig. 1; the following illustrate verbal items (as in 
the test manual, accompanied by scoring criteria, so that memori- 
zation by the examiner is not necessary). 

(A) 3. The school doctor looked at three of the children and then closed 
the school. Why did he close the school? 

Plus. Contagious or infectious disease; e.g., something catching; fear of 

epidemic. 

Minus. Specific diseases or disabilities; e.g., colds; disease Q mumps; 

disease Q some one got sick; children were undernourished. 


* The grant-in-aid from the Cooper Research Fund made it possible later to 
obtain the services of a professional artist, Miss Betty Pamphilon. Certain final 
changes and one complete drawing were done by Dorothy Marcuse, Queen’s 
University. 
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(A) 14. Mr. Smith’s family, with relatives and friends, were gathered in 
his house, talking in whispers and waiting for something to begin. What? 


Plus. A: funeral or will-reading (sombre events with Smith absent). 

B: operation; waiting for the doctor’s verdict; afraid Q afraid of a death. 

Minus. Meeting; party; wedding; surprise party; a row; an air raid; 
child-birth. 


(A) 19. ‘‘No one could fix that stove,” said Mr. Black. “If you can’t 
no one can,” answered his wife. Mr. Black changed his mind and looked to 
see what could be done. Why? 


Plus. More or less specific reference to flattery, vanity, etc.; e.g., his 
pride; soft soap; try again Q after praise; didn’t want her to think he 
couldn’t do it (borderline plus) ; to raise himself in her opinion (borderline). 

Minus. She knew him well—if he couldn’t, no one could; laziness Q he 
could if he tried; he was a plumber; etc. 


(A) 23. “It’s all right to be agreeable,” said the foreman, ‘but I’d like 
that man better if he didn’t—” If he didn’t what? 


Plus. Yield his opinions or agree too readily; e.g., too much of a back- 
slapper Q too agreeable; he was a yes-man; too familiar—too easy with 
his men (borderline). 

Minus. Talk too much, trying to be agreeable; drink; be loud-mouthed; 
swear; talk about his work-mates; quarrel. 


MANNER OF ADMINISTRATION 


The procedure with these tests is designed as far as possible to get 
the subject away from a problem-solving attitude, as Binet’s procedure 
does with a child, and to present a ‘‘real’’ situation in which the 
subject gives the judgment that he would make if he encountered it in 
life. Obviously this can only be approximated. A verbal test 
involves verbal comprehension whether this is aimed at or not, but by 
repeating the item as often as the subject wishes, by sticking to simple 
words and simple sentence structure, and by emphasizing the request 
for a common-sense judgment of a common situation we have tried to 
approach the goal as closely as possible. Similarly, the practice items 
of the pictorial test are chosen to make clear that sketchy drawing is to 
be disregarded, that it is ludicrous human action that is to be looked 
for; and all items are such as to minimize either visual acuity or the 
importance of details of drawing. Complex verbal instructions are a 
common flaw in “‘non-verbal”’ tests, and by the use of a large number 





The McGill Adult Comprehension Examination 19 


of examples we have avoided the necessity of saying more than, 
‘‘Show me what is funny or out of place.” 
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Fic. 1.—Examples of test items. For actual testing these are printed one per 
page, 13 X 17 cm. The present reduction in size somewhat changes the perceptual 
characteristics of the pictures. 

Each test has two parallel forms. The time of administration for 
one form of the verbal test is likely to be from fifteen to twenty-five 
minutes, with some subjects under or over these limits. The pic- 
torial test usually takes from ten to twenty minutes. In order to 
provide shorter tests, we have provided norms also for twenty verbal 
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and twenty-one pictorial items, obtained by rescoring the records of 
subjects who were given the full test. We have not actually used 
these shorter forms, and the norms given are estimates only. We 
recognize that both tests are much longer than is suited to many 
needs. Our object was to supply enough material for good reliability, 
if this should be desired; if not, we felt that the user of the test might 
shorten it to suit himself (as for example by taking every odd-numbered 
item of the twenty-five verbal problems) and set up his own norms to 
correspond. 


STANDARDIZATION AND STATISTICAL DATA 


During the earlier part of the work, subjects were obtained chiefly 
from the public wards of the Royal Victoria Hospital, Montreal, and 
the Kingston General Hospital; the final standardization data to be 
reported here were chiefly obtained from subjects hired at employment 
bureaus. The hospital population seems far the most satisfactory one 
as a sample of the population at large, but wartime conditions of 
hospital crowding made this source of subjects inaccessible. The 
war’s effect on employment also affected our study during 1940 and 
1941: the subjects to be met at the employment agency were not the 
most employable, but rather below average. We found it advisable to 
supplement this source of subjects by a kind of grapevine communi- 
cation to the effect that we would pay fifty cents an hour to people 
otherwise employed, and obtained a number of subjects by this means 
for two or three hours’ work in the evenings. All subjects were 
English speaking and most of them were born in Canada. 

In these circumstances, we do not feel that occupational ratings are 
meaningful for our main supply of subjects—in the wartime demand 
for labor, unskilled labor reported itself as semi-skilled or skilled. 
Our more reliable indices are reports of degree of education of the 
subject, and his Stanford-Binet vocabulary score. It should be said 
in the first place that we have obtained an unsophisticated group as a 
whole. There were almost no refusals among hospital patients or 
those subjects approached at the employment bureaus. For such an 
unselected population, the similarity of our group to that of Weisen- 
burg, Roe and McBride‘ in mean education, and in mean and distri- 
bution of vocabulary scores suggests that as a whole our group is a 
rather good representation of the general population. Actually, we 
are dealing with two subgroups which overlap; the pictorial test was in 
its final form before the verbal test, and standardization data for the 
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two tests are not based on identical samples. The two samples are 
similar, however. Mean educational level for the pictorial-test group 
is 7.7 school grades; for the verbal-test group, 7.1. The first group 
contained a much higher proportion of subjects from the Province of 
Ontario, with compulsory education; the second was equally from 
Ontario and Quebec, and since the latter Province has no compulsory 
education the average educational level is lower. Taking this into 
account, the educational level of our groups roughly corresponds with 
Weisenburg, Roe and McBride’s mean level of 8.0 grades. Table I 
summarizes the comparison of their Stanford vocabulary test scores 
with those in each of our two groups. 

In one respect it appears that our group is not as representative as 
Weisenburg’s—in getting a good sample in each age decade. The 


TABLE I.—CHARACTERISTICS OF STANFORD VOCABULARY SCORES MADE 
BY Two STANDARDIZATION GROUPS, AND BY WEISENBURG, ROE 
AND McBripe’s Group 


MEAN STANDARD 
GROUP ScorE RANGE DEVIATION 
VSS* standardization.............. 27.0 10-44 oe 
PAS? standardization.............. 26.8 10—46 7.6 
WRMcB normal control........... 54.5f  25-86f 15.6f 


* Verbal Situation Series. 
t Picture Anomaly Series. 
t Weisenburg, Roe and McBride report only total score for both vocabulary 


lists; our data are for the first list. 


upper decades particularly appear unsatisfactory. There is no 
evidence, however, in the total group, of an unusual degree of disper- 
sion of ability to raise correlations spuriously—particularly important 
in considering the question of test reliability. 

Reliability of the verbal test: In the next to last revision of the Verbal 
Situation Series, two series of thirty-two items were used with thirty 
subjects, giving a test-retest reliability of .92. The test was then cut 
down to twenty-five items; rescoring gave a reliability of .89. The 
test in its present form was then given to thirty-six new subjects, with a 
test-retest reliability of .92. In this last group, however, there were 
a number of older subjects who made low scores, suggesting, of course, 
a loss of ability with age and hence that the reliability obtained was 
spurious. No evidence of loss could be found before the age of forty 
years, so reliability was calculated for a group between the ages of 
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twenty and forty. But to get a large enough group for this purpose, 
we had to include the subjects in this age range from the preceding 
group as well, and the resultant reliability was not lower, but higher: 
.93 instead of .92. We feel, therefore, that the reliability of the test 
(correlating one form with another) in a representative group of 
adults is likely to remain very close to or above .90, and hence that it is 
reasonably discriminative in individual diagnosis. 

Reliability of the pictorial test: In the next to last revision of the 
Picture Anomaly Series, a product-moment reliability of .93 was 
obtained with forty-one subjects chiefly from the public wards of the 


TABLE II.—MEAN Scores By AGE DECADES AND FOR TOTAL GROUP 
ON VERBAL SITUATION SERIES, TOGETHER WITH MEAN STANFORD 
VOCABULARY SCORES FOR THE SAME SUBJECTS 


ALL 
AGE GrRouP 20-29 30-39 40-49 50-59 60-69 CasEs 
Number of cases......... 15 16 14 9 11 65 
Vocabulary mean........ 25.5 30.3 26.7 26.6 28.8 27.7 
VSS mean, Form A...... 12.7 13.6 9.8 10.3 10.3 11.5 
VSS mean, Form B...... 12.7 14.7 10.6 9.3 10.5 11.9 


Kingston General Hospital, using two lists of thirty-four items. 
Item analysis eliminated four items from each list, with resultant 
reliability of .946 for all subjects. This again, however, is spurious 
because of an age effect, and for a group of thirty-three subjects 
between the ages of twenty and thirty-nine years of age (there is no 
apparent effect of age before forty years) the reliability is .91; the 
heterogeneity of this group, as judged by a standard deviation of 
Stanford vocabulary scores equal to 7.3, is slightly less than that of 
Weisenburg, Roe and McBride’s group (they report a SD of 15.6 for 
total score on two vocabulary lists; our data are for the first list only). 

The data fo Tables II and III will show that the norms for ages 
over forty are not good, but computations made by matching small 
groups of younger and older subjects for vocabulary and education 
give an estimate of norms as follows: VSS (verbal test) Form A, ages 
twenty to thirty-nine, 13.2; forty to sixty-nine, 10.2; PAS (pictorial 
test) Form M, ages twenty to thirty-nine, 20.2; forty to forty-nine, 
17.1; fifty to sixty-five, 14.5. The curves for change of mean score 
with age for both tests appear to dip downward about forty years of 
age, with a maintained level in the twenties and thirties, and, for the 
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Verbal Situation Series, a maintained level after the forties into the 
sixties. This unusual curve for the verbal test may, of course, simply 
be due to errors of sampling, but it may be observed that apparently 
similar curves are given by Jones and Conrad in their Army Alpha 
data’ except that the dip in their curves appears earlier. In our final 
standardization of the Verbal Situation Series we have included no 
subjects in the sixteen- to nineteen-age range, but work with earlier 
forms of the test suggested strongly that socially immature persons 
(under the age of twenty, that is) were handicapped; or, in other words, 
that the test measures in part a definitely adult experience. This is 
not established finally, however. The Picture Anomaly Series, on the 


TABLE IIJ.—Mgan Scores By AGE DECADES AND FoR ToTAL Group 
ON PicruRE ANOMALY SERIES, WITH MEAN STANFORD 
VOCABULARY SCORES FOR THE SAME SUBJECTS 

ALL 
AGE Group 16-19 20-29 30-39 40-49 50-59 60-65 CaszEs 
Number of cases... 10 27 27 21 8 7 100 
Vocabulary mean.. 23.8 25.7 29.2 29.0 22.9 26.6 26.8 
PAS mean, Form M 20.3 19.7 20.7 17.1 10.0 14.6 18.5 


other hand, while it is as interesting to adults, and constructed espe- 
cially for them, appears to be quite within the range of ’teen-age 
children, and from studies done by Miss Eva Zbar and Miss Anne 
Howse it is evident that the test may be discriminative and useful with 
children as young as eight years: a tentative norm of 17 for eleven- 
year-old children has been established in the pictorial test, Form M. 
Comparison of thirty-one male and thirty-one female subjects, 
matched for age, education and vocabulary score, showed no significant 
difference in score on the pictorial test. Standardization of the Verbal 
Situation Series, involving almost no hospital patients, was done mostly 
with male subjects, and a good comparison of men with women was 
not possible. Ina small group, inadequately matched, there appeared 
to be a definite superiority of the males, but it is not clear whether 
this would be borne out in a larger group or not; if it is, it may be a 
sign that the test is loaded somewhat with questions of male interest. 


CORRELATIONS WITH OTHER TESTS; VALIDITY 


In a group of thirty-four cases the following tests wer> given, in the 
course of standardizing the Verbal Situation Series: Verbal Situation 
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Series, Picture Anomaly Series, Stanford-Binet vocabulary list (first 
half, old form) and a revision of the Weisenburg and McBride Analogies 
test (to be described). The inter-test correlations are presented in 
Table IV. Only one comment need be added, that there was no 
important vocabulary loading in the Analogies and Verbal Situation 
Series spuriously to increase correlations between verbal measures. 
We have discussed elsewhere (Hebb and Morton?) the question 
of test validity, and the theoretical difficulties which we believe are 
to be found in trying to give any quantitative statement of the extent 
to which a test measures intelligence. Indeed, we have gone farther, 
and have adopted the position that, in the face of the evidence from 
factor analysis and other recent work, it is misleading even to suppose 


TaBLE IV.—INTERCORRELATIONS BETWEEN Four TEsts, VERBAL 
SITUATION, PicTURE ANOMALY, ANALOGIES AND VOCABULARY 
(INCLUDING SELF-CORRELATIONS) 


TEST VERBAL PicTuRE ANALOGIES VOCABULARY 
ES oie wis gb be 4000-0 .92 
ES ee .75 .94 
Analogies........... .77 . 60 .92 
Vocabulary.......... .85 . 59 .72 .95* 


* The self-correlation according to Weisenburg, Roe and McBride (1936). 


that one can measure intelligence by the available methods. We have 
not hesitated, therefore, to deny, in getting the consent of normal 
control subjects to act as such, that these tests are measures of intelli- 
gence. On the face of it, the content of the tests suggests that they 
measure a kind of cultural comprehension which may be important in 
itself, and that the degree of comprehension may provide a better 
basis for estimating or rating intelligence than many current tests. 
In the ordinary usage of the term, these new measures may be more 
valid intelligence tests, particularly for use with run-of-the-mill adult 
subjects. One thing that was demonstrated by Binet, and even more 
clearly by Terman’s revisions of Binet, is that intellectual level is 
better determined in relation to the tasks and problem-solving of 
everyday life, where motivation is good and degree of experience more 
equal, than in formal and abstract problem-slving. It is at least 
worth trying to discover whether the same may be true of adult sub- 
jects, and in these tests we have presented the adult with problems 
which bear some relation to his ordinary everyday concerns. 
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| MENTALLY LIMITED PERSONNEL IN THE 


| MILITARY SERVICE! 
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ie Lt. Col., A. G. D. 


| INTRODUCTION 


“Our rapidly growing Army is a complex machine. 
vii its parts, material and human, must be perfectly codérdinated 
Hh toward the achievement of Victory over our enemies. 


Coérdina- 


tion means, above all, knowledge and skill on the part of every 
Thus has 


Secretary of War Stimson succinctly revealed the views of the 

Army with regard to human requirements if Victory is to be ours. 

General Brehon B. Somervell, Commanding General, Services 

i of Supply, has said, ‘‘ We can lose this total war on the battlefront 


soldier in the use of mechanisms of many kinds.” 
{ 
: 


a} is the backbone of an Army.” 


as a direct result of losing it on the educational front. Education 

Many other leaders of our great military organization have 
repeatedly emphasized the need for men who are intellectually 
equipped and educationally trained to carry out the many and 
varied activities that are an intrinsic part of organized warfare. 


This need is not limited to men who are average or above-average 
\ in intelligence and training; it includes also those men who are 
; lacking in formal education, limited in intelligence or deficient 


in the ability to speak English. It appears that a majority of 
the men in these groups can be salvaged and made available for 
military service. The responsibility for this important work 
rests with agencies both within the Army and external to it. 


H The accomplishment of the program within the Army neces- 
sitates: first, the identification and accurate classification of 
ee men falling into several categories of physically and intellectually 
i limited groups including the sub-average learner, the linguis- 
a tically retarded, the foreign language literate, and the Eng- 
' lish-speaking illiterate; second, the placement in appropriate 
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instructional groups of men so classified; third, the development 
and administration of efficient programs of instruction; and, 


1A paper to be read at the Annual Meeting, American Orthopsychiatric 
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fourth, the determination of ‘‘readiness’”’ for reassignment in a 
regular training unit. 


TYPES OF PROBLEMS HANDLED IN SPECIAL TRAINING UNITS 


For military reasons it is not desirable to present the actual 
numbers of such personnel in the Army, yet/it is obvious that the 
numbers involved are about the same or perhaps slightly less 
than the number normally distributed among such groups in 
the general male adult population of draft age. The numbers 
and geographic distribution within these groups correspond 
rather closely to the frequencies clearly recognized as representa- 
tive of the educational levels in the various states. } 

The following educational problems are the special concern 
of those engaged in the program of the Special Training Units. 
They are discussed according to the categories in which the men 
are distributed. 

(a) The English-speaking Illiterate and Semi-literate Group.— 
This includes all men who have entered the Army with very 
marked deficiencies in their ability to read and write English. 
Some of these men though intelligent have been denied oppor- 
tunities for formal schooling. Others have been limited in their 
capacity to absorb such instruction because of varying degrees 
of mental retardation. Whatever the cause, men in this group 
cannot progress satisfactorily in the regular program of the 
Army. They must have training in the basic skills essential 
in understanding the materials of instruction ordinarily employed 
by the Army. From a functional standpoint, the Army is 
concerned only with the task of bringing this group of men up to 
that level of proficiency in reading, writing and arithmetic which 
will enable them to profit from regular Army instruction and to 
carry out successfully the duties required of them. 

(b) Non-English Speaking Men, Literate in Their Own Tongue. 
This group includes all foreign-speaking men whose ability to 
read and write English is negligible, but who are definitely 
literate in their native tongue. The problem presented here 
is one of accurate identification and efficient instruction. 

(c) Non-English Speaking Men, Illiterate in Their Native 
Tongue as Well as in English.—This category includes men who 
are not only illiterate but who also cannot understand English. 
This group presents many serious problems. Although small 
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in absolute numbers, the group is very difficult to train because 
of the necessity of establishing the initial steps in linguistic 
orientation and development. 

(d) Literate Men Whose Capacity to Absorb Instruction Is Less 
than That Required in Regular Training Units—These men 
frequently are mentally dull or have other psychological defi- 
ciencies that prevent their acquiring knowledge at an acceptable 
average rate. Again, accurate identification and classification 
presents a difficult but challenging problem. 

(e) Physically Handicapped Men, Acceptable for Military 
Duty.—It is well at this point to call attention to the fact that 
at the present time there are being inducted fairly large numbers 
of men with minor physical limitations for which they have 
succeeded in making satisfactory physical adjustment in civilian 
life. These men will be able, it is hoped, to make a similar 
adjustment in military life. They often require some stamina- 
building physical training in order to effect a satisfactory transi- 
tion from civilian life to the increased physical demands of Army 
life. To give this in the course of regular training might, in 
many instances, slow up the training program; in addition, a 
harmful effect on morale might be produced if the regular training 
were modified by the exceptions necessary to accomodate these 
men. It is therefore better, in general, where there are large 
numbers of such men to place them in a Special Training Unit. 


THE METHODS OF DEALING WITH THE PROBLEMS 


Special training places particular emphasis upon: (a) selection 
of men required to receive such training, (b) selection and training 
of personnel to do the teaching, (c) development and supply of 
materials used in the selection and training of the men, and (d) 
proper assignment of men at the conclusion of their instruction. 

(a) Selection of Men to Receive Special Training.—A general 
description of the types of men who are the recipients of special 
training has already been given. Unfortunately, however, there 
are time and space limitations within the Army which prevent 
the assignment to Special Training Units in unlimited numbers 
of all the men in these categories. It is, therefore, necessary to 
exercise extreme care in order that only those men who are 
definitely in need of this training and can be expected definitely 
to profit from it are selected for Special Training Units. 
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The established policy calls for the assignment of all men who 
are totally illiterate and all men who are in the non-English 
speaking categories directly to Special Training Units within the 
organization to which they are assigned. Such men are so 
handicapped by their language deficiencies that they cannot be 
expected to understand oral or written military instruction until 
their functional language capacity is established on a level 
commensurate with the minimum language requirements of 
such training. They must acquire a usable functional vocabu- 
lary of about three thousand words including the most common 
military terms. The men must not only recognize the words 
singly, but they must also appreciate the meaning of the words 
in context within sentences and simple paragraphs. 

The selection of men who are semi-literate presents a more 
complicated problem. Where the deficiencies are minor, the 
man can be expected to get along satisfactorily in regular training 
without further help or with such additional help as might be 
obtained by attendance at an evening literacy school several 
times a week. It is unnecessary to send such a man to a Special 
Training Unit. If, on the other hand, the probability of success 
in regular training is doubtful without extensive instruction in 
the basic academic subjects, the man should be assigned to such 
a unit. The determination of the need for special training can 
best be made by use of (1) a literacy test designed to measure 
the relative degree of functional literacy and (2) by the success 
of the man in regular training. 

The measurement of the first factor is expected to be accom- 
plished more successfully than in the past through the use of a 
Picture Literacy Test which has recently been developed. This 
test requires not only the recognition of pictures and the ability 
to write or print the appropriate word symbol—but, also, the 
ability to recognize their functional use. Although the test 
has not yet been completely standardized, the evidence indicates 
that when the individual’s test score is high, we can assume an 
adequate background and assign him directly to a regular training 
unit; but when it is low, he must take special training prior to 
assignment to regular military instruction. 

Another selective factor enters into this situation. Each man 
is given an individual psychological examination in order that 
his mental and social competency may be correctly appraised. 
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When the results of this study reveal that individuals possess 
too little of “‘what it takes” to carry on successfully during 
special training or later in regular training they are recommended 
for removal from military service by the appropriate military 
action. 

Errors in recognition of men not qualified for military service 
can and do occur, especially when the numbers to be processed 
through induction stations and reception centers have assumed 
proportions that reduce effective screening. This procedure 
decreases expenditures of time and effort on men who cannot 
profit from instruction. 

(b) Selection and Training of Teaching Personnel.—The selec- 
tion of men requiring special training having been accomplished, 
it is necessary to provide them with teachers skilled in the arts 
and sciences that are part of adult elementary instruction. To 
the civilian accustomed to look upon the educational system 
as a centrally-controlled activity, it may appear strange that 
the military organization is not so organized. In many ways 
such a plan would be ideal were it not for the very serious and 
basic fact that the principal mission of the military is the success- 
ful and rapid prosecution of a war that is larger in scope and 
battle area than any war in the history of the world. 

To carry on such a program expeditiously, it is necessary that 
control of the applications of training be decentralized, thus 
making each unit commander, rather than one or more indi- 
viduals or agencies ‘‘up top,”’ responsible for the accomplishment 
of that program. 

This means, therefore, that Special Training Units are organ- 
ized and operated in accordance with War Department policy 
but under the direct control and supervision of the individual 
organization commanders of the Army. For example, command- 
ing officers of the armies, corps, divisions, service commands, 
replacement training centers, etc., are individually responsible 
to their respective commanders for the establishment and success- 
ful operation of all training in their organizations, including that 
of Special Training Units. 

In keeping with this policy the War Department does not 
actually select the teachers for these units. It does, however, 
supply military units with pertinent information relative to the 
best methods for securing the kind of personnel best qualified for 
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these duties. This information is furnished by direct contact 
with organization commanders and their subordinates made 
through inspections and by written reports, memoranda, and 
by directives on training doctrine and policy sent from the War 
Department and its subordinate headquarters to the various 
units of the Army. 

In general, commanders responsible for the establishment of 
Special Training Units have been extremely judicious in selecting 
men for instructors of these units. A recent survey of a large 
segment of the Special Training Units in the Army revealed that 
approximately seventy-five per cent of all the teachers in Special 
Training Units had had actual teaching experience prior to 
entering the Army and more than fifty-five per cent of these 
instructors had been specifically trained to deal with problems 
in the field of elementary education or in the training of the 
mentally dull and retarded. Although this does not constitute 
an ideal, it is much better than might have been anticipated in 
view of the fact that this problem was one that had to be super- 
imposed upon a multiplicity of equally important training tasks 
required of the Army. Furthermore, the professional calibre 
of instructors being assigned to special training has definitely 
improved as shown by a steady growth in the excellence of 
training experience and academic background reported. 

To improve the quality of instruction, a course for potential 
instructors in Special Training Units is now being prepared for 
issuance by the Army Institute. The aim of this course is to 
supply the enlisted personnel of the Army with background 
material in general pedagogy and in specific methods applicable 
to Special Training Units. It is anticipated that this course 
will be given only to those men whose academic training indicates 
a definite aptitude and interest in teaching, and whom com- 
manders could rely upon for carrying on this type of work within 
their organizations. By this process, men who have had limited 
experience may become equipped for the task. 

In addition to these procedures for training the instructor, 
there are made available teachers’ guides and handbooks, con- 
structed specifically for use in teaching the materials supplied to 
Special Training Units. These are to augment and assist the 
teacher in the interpretation of the actual subject content of film 
strips, regular and collateral reading materials, and other teaching 
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and learning aids. Every effort is being made to give the 
instructor the kind of a background, both military and edu- 
cational, that will insure his ability to teach intelligently and 
effectively. 

(c) Development of Instructional Materials.—After students 
have been selected and instructors chosen and trained, it is 
essential that suitable instructional materials be made available. 

In some types of training within the armed forces, it is a fairly 
simple matter to select from among existing civilian textbooks 
that material which is of military value; one can then proceed 
promptly to adapt it for use within the Army. Unfortunately, 
suitable text material useful for the instruction of adults in 
elementary subjects is meager. Most of the existing textbooks 
are not adaptable to the military environment; as a result, it is 
necessary for the Army to develop the major portion of the 
instructional books and devices for Special Training Units. 

In order to meet the problem in the initial phases of the 
development of this training program, texts were developed 
hastily—correcting in many instances recognized existing errors 
in the few texts that were on the market, and shaping the con- 
tents to fit into the military requirements of the individuals 
undergoing instruction. 

These texts, however, are now undergoing revision. The new 
texts are based upon actual experience with this material in the 
instructing of men assigned to Special Training Units. The 
elimination of extraneous matter, the addition of more pertinent, 
more easily taught and clearer contents, has been the constant 
goal of those engaged in the production of readers and related 
devices. 

From a practical standpoint the Army seeks to keep the volume 
of materials at a minimum; but, at the same time, it aims to 
have them of qualitative excellence. All the reading, writing 
and arithmetic taught must be accomplished in a maximum of 
thirteen weeks; hence, materials must be compact and of such 
a nature that they will motivate the student strongly. To 
facilitate this purpose, supplementary aids in reading, writing, 
and arithmetic have been devised. In addition, monthly and 
weekly periodicals, film strips, etc., have been developed and are 
being extended for the purpose of vitalizing the learning situation. 
An effort is made to carry into the military training of the man 
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as much opportunity as possible for direct and recognizable appli- 
cation of his academic training. This makes the rationale for 
the required instruction in the three “ 2’s’’ more readily apparent 
to the learner, thus securing his wholehearted codperation. 

Extensive use has been made of graphic presentation of 
subject-matter. Wherever possible, pictures and sketches have 
been employed in order that the learner might readily associate 
language symbols with recognized objects that are part of his 
daily life. What is more, an emphasis has been placed upon the 
clarity of the pictorial representation. 

Reading and arithmetic lend themselves to being “‘speeded up”’ 
by the use of direct visual aids. Abstract concepts that are 
difficult to classify by the use of words in many instances are 
quickly grasped when the learner sees those concepts applied to 
pictorial subject-matter. An effort has been made to utilize 
an eclectic approach in the techniques selected, using those 
which evidence indicates are most likely to be successful with 
the largest number of men. 7 

The preparation of material for instructional purposes in the 
Special Training Units is in the hands of qualified professional 
experts who have worked diligently at this never-ending task. 
In addition, many civilians with long experience in the field of 
adult education, literacy training, and elementary education are 
contributing their counsel and guidance. The results thus far 
have been gratifying—practically all of the books and visual 
aids are highly functionalized and fit well into the military 
program. A student using this material is not necessarily 
capable of reading much classical English, nor is he even required 
to be capable of rapid reading in simple books—yet, he can read 
well enough to meet the demands placed upon him in regular 
training units. This is true also of his ability to write, and to 
perform simple operations in arithmetic. 

(d) Disposition of Men during or at the Completion of Special 
Training.—The great majority of men sent to Special Training 
Units succeed in learning enough of the three “‘R’s”’ and perform 
sufficiently well in their military instruction given concurrently 
to support the view that they will make acceptable soldiers. 
Some men do this in a six- or eight-week period; others require 
the total period of thirteen weeks. Whenever the evidence in 
the classroom and the field indicate the attainment of the 
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capacity to carry on in the regular training program, the indi- 
vidual is recommended for return to regular training and is in 
a sense “‘graduated”’ from this elementary training school. 

A small proportion of men reveal, during the period of their 
special training, a complete lack of qualification for military 
service. When this occurs, they are recommended for the 
appropriate action culminating in honorable discharge from the 
Army and a return to civil life. Here they may engage in useful 
war-time vocational activities under circumstances more adapted 
to their capacity to serve. Their discharge from the Army is 
honorable, since they cannot be blamed for their deficiencies; 
however, they can not be utilized within the Army without 
jeopardy of their own welfare and that of their associates. 

Obviously, the actual number of men discharged in this way 
is very small. The use of a careful clinical approach tends to 
reduce malingering or fraud almost to the zero level. The total 
salvage of men useful to the service is, however, significantly 
great. In addition, their degree of usefulness is enhanced 
through this training program. Unit commanders of the Army 
are becoming convinced of these facts as direct contact with 
‘“‘graduated”’ personnel from Special Training Units increases. 

This program has developed over a period of slightly more than 
a year. It has already made a definite contribution to the 
effective manpower in the Army. With the development of 
extra-military agencies to carry on this work prior to induction, 
there may be anticipated some slackening of the task in so far 
as numbers of men requiring such training are concerned, but 
in all probability, it will continue to be used as a means of 
improving the status of slower-learning literate personnel, men 
with limited physical stamina and those who because of the 
rapidity of growth in the Army must be inducted with very 
meager linguistic attainments. 





A FOLLOW-UP STUDY OF EDUCATIONAL 
ATTAINMENT OF GIFTED NEGROES 


PAUL WITTY AND VIOLA THEMAN 


Northwestern University 


Most of the early studies of gifted children included few 
Negro subjects. However, from 1930-1935 several studies of 
bright Negro children appeared. Among these was the 1935 
investigation of Martin D. Jenkins,'! who selected for intensive 
study one hundred three children having IQ’s 120 and higher 
from eight thousand Negro pupils in grades III to VIII of 
Chicago elementary schools. After an interval of six years, the 
abilities and interests of these subjects as high-school and college 
youth were measured in a subsequent study.? 

In 1940-1941 the average chronological age of the eighty-four 
who could be identified was 16 years, 0 months; there were at 
this time twenty-three boys and sixty-one girls who were dis- 
tributed through grades IX to XVI. The median grade was 
the eleventh, or the third year of high school. Twelve youth 
were not attending school. 

In this paper, we shall indicate the educational progress and 
status of this group and make a number of comparisons with 


the original study. 


EDUCATIONAL ACHIEVEMENT IN 1934 


To measure the educational achievement of these children 
Jenkins used in 1934 the New Stanford Achievement Test, 
Advanced Examination, Form W. The total score of each 
child on this test, as well as the scores in each of the sub-tests, 
were ascertained. Jenkins stated: 

“The average pupil of this group has mastered educational 
subject-matter (as measured by the Stanford Achievement Test) 
2.7 grades above the norm for his chronological age and 1.1 
grades above the norm for his present grade placement. While 





i Jenkins, Martin D.: A Socio-Psychological Study of Negro Children, 
unpublished Doctor’s dissertation, Northwestern University, Evanston, 
Illinois, 1935. 

2 Theman, Viola: A Follow-up Study of Negro Youth of Superior Intelligence, 
unpublished Doctor’s dissertation, Northwestern University, Evanston, 


Illinois, 1942. 
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five children made total scores below their grade-norm, no child 
scored below his chronological age norm. 

“The group achieved best in those subjects which are appar- 
ently most susceptible to out-of-school influences, the highest 
mean score being in reading (mean 135.3, SD 11.8) and language 
usage (mean 133.8, SD 19.9). The mean reading quotient is 
higher than the mean IQ. The lowest mean scores are in 
arithmetic reasoning (mean 121.9, SD 13.3) and arithmetic 
computation (mean 122.4, SD 14.7). 

“The mean educational quotient is 127.2, SD 10.2, while the 
mean accomplishment quotient is 95.4, SD 6.9.’”! 

These results were somewhat similar to those reported by 
Witty, who found that superior children in the elementary 
school ‘‘appear to have a knowledge of educational subject- 
matter at least two years in excess of their grade placement.’’? 

Witty and Jenkins reported the educational achievement of 
twenty-six of these Negro children; their IQ’s as measured on 
the Stanford-Binet were 140 and above. 


(1) The mean IQ (Stanford-Binet) is 148.9; the mean EQ 133.7; 
and the mean AQ 91. 

(2) The mean grade placement is 5.9 and the mean age of the group 
is nine years and ten months. The mean progress quotient is one 
hundred twenty. 

(3) The average pupil has mastered the subject-matter (as measured 
by the New Stanford Achievement Test) 1.4 grades above his present 
grade placement and 3.3 grades in advance of that of the norm for 
children of his chronological age. 

(4) The highest subject quotients are in language usage (146.6) and in 
reading (143.8) and the lowest is in arithmetic computation (126.5). 

(5) Statistical treatment of the data suggests that mental age con- 
tributes heavily to educational age. 

(6) There is an unusually large number of girls in this group, the 
distribution including nineteen girls and seven boys.® 





1 Jenkins, Martin D.: op. cit., p. 122. 

2 Witty, Paul A.: “A Genetic Study of Fifty Gifted Children,” Yearbook 
of National Society for the Study of Education, Vol. xxxrx, Part II. Bloom- 
ington, Illinois: Public School Publishing Co., 1940, p. 405. 

* Witty, Paul A. and Jenkins, Martin D.: ‘‘The Educational Achievement 
of a Group of Gifted Negro Children.” Journal of Educational Psychology, 
Vol. xxv, No. 8, November, 1934, pp. 594-595. 
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The authors concluded that these twenty-six children did not 
reach a level of educational attainment consonant with expec- 
tations based upon mental tests, although they did display 
educational superiority in all subject-matter areas. In both 
these respects the Negro children conformed closely to the 
pattern of other groups of gifted children. 


EDUCATIONAL ACHIEVEMENT MEASURED IN 1940 


To determine to what extent superior Negro children identified 
in the elementary schools justify early expectations by their 
accomplishments during high school and college, a follow-up 


TABLE I.—PERCENTILE RANKS OF 82 SUPERIOR NEGROES ON THE 
Myers-Rucs Test 
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Median percentile......... 58.57, SD 24.2 


study of Jenkin’s one hundred three subjects was made six 
years later by Viola Theman. To measure the educational 
achievement of these youth in 1940, two standardized tests were 
employed: the Myers-Ruch High-School Progress Test and the 
1940 Iowa Every-Pupil Test in Understanding of Contemporary 
Affairs. The former is designed to measure mastery of the 
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content of the high-school course of study. Four subject areas 
are tested; namely, English, social studies, mathematics, and 
science. The latter is limited to one area. 

The underageness of this group! should be borne in mind in 
interpreting the percentile rankings (Table I) on the Myers- 
Ruch Test. Total scores were converted into percentile ranks. 
The scores of the high-school graduates and college students 
were distributed according to the percentiles for high-school 
seniors since higher norms were unavailable. 

As measured by the Myers-Ruch Test, the educational achieve- 
ment of this group is somewhat above the norms. The attain- 
ment of individuals within the group varies greatly and extends 
from the thirteenth to the ninety-ninth percentile. This 
attainment is by no means as outstanding as that reported in 
investigations of other gifted groups.2 For example, Terman 
used the Iowa High School Content Examination with two 
groups of gifted high-school seniors; 45.2 per cent of one group 
and 26.5 per cent of a second rated at the ninety-ninth per- 
centile.* Only 3.2 per cent of the first and 20.7 per cent of the 
second group fell below the ninety-fifth percentile. 

Since Terman’s subjects all reached or exceeded IQ 140, the 
foregoing comparisons may prove misleading. The scores of the 
twenty-eight Negro pupils‘ having IQ’s 140 plus were therefore 
considered. Half the scores on the Myers-Ruch Test were 





1 The underageness of this group in 1940 was similar to that reported in 
1934 when eighty-one per cent of the boys and girls were underage for their 
grade; the average pupil was 1.7 half years accelerated; and the range of 
underageness extended from one-half year to three and one-half years. 
(Jenkins, op. cit., pp. 91-94.) 

2 Terman, Lewis and Oden, Melita: “Correlates of Adult Achievement in 
the California Gifted Group,” Yearbook of National Society for the Study of 
Education, Vol. xxxtx, Part I, Bloomington, Illinois: Public School Publish- 
ing Co., 1940, p. 79. 

3 Note: Terman divided his superior white youth into three groups on the 
basis of achievement. The A group was composed of the most successful 
individuals and the C group was made up of the least successful. Three 
judges made independent ratings based on professional recognition, academic 
marks and income. 

4 Twenty-nine of one hundred three youth identified by Jenkins had Binet 
IQ’s 140 and above. Jenkins administered educational tests to twenty-six 
of these children. In 1940 Theman administered educational tests to 
twenty-eight of the youth. 











Educational Attainment of Gifted Negroes 39 


above the seventy-fifth percentile. The “average child” in this 
group made a significantly higher record of achievement than 
did the “average child” in the larger group. The distribution 
of scores is found in Table IT. 


TaBLE II.—Scores or TWENTY-EIGHT GIFTED NEGROES ON 
Myrers-Rucu Hiesr ScuHoot Proaress Test 
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The scores on the Iowa Every-Pupil Test in Understanding of 
Contemporary Affairs were treated in a similar way. Since 
grade medians are available for this test only for the four years 
of high school, the scores of all college students were converted 
into percentiles in terms of the norms for high-school seniors. 
Table III reveals the percentile rankings for the entire group. 

The mean percentile rank of these youth (53.7, SD 24.0) is 
slightly above the average. The range extends from the sixth 
to the ninety-seventh percentile. 

Several comparisons made it clear that these scores are reliably 
superior. For example, the 1938 form of this test was admin- 





1 Baker, Emily V.: ‘Those Who Watch Our Ramparts,” Educational 
Administration and Supervision, Vol. xxv, Oct., 1939, pp. 513-522. 
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istered by Baker! to four hundred six students in six state 
teachers colleges, and the percentages of students falling below 
the median score for high-school seniors were ascertained. 
Sixty-four per cent of the freshmen and forty-two per cent of 
the sophomores made scores below the median. In contrast 
with these percentages, only thirty-six per cent of the superior 
Negro youth who had left or graduated from high school fell 


TaBLE III].—PERCENTILE RANKS OF EIGHTY-TWO SUPERIOR 
NEGROES ON THE Iowa TEST IN UNDERSTANDING OF 
CONTEMPORARY AFFAIRS 
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below the median. These Negro youth, as a group, appear to 
have a better understanding of contemporary affairs, as measured 
by this test, than do typical pupils. 

Grades in School Subjects and Rank in High-school Classes.— 
Witty found that with the exception of a boy who was ranked 
by his teacher as being average in his school subjects, the mean 
scholastic rank of every one of the gifted white youth he studied 
was markedly above average. The girls’ ranks were slightly 
above those of the boys. At the time of his third study, when 
most of the youth were in college, almost half of the marks of 
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the boys and seventy per cent of those of the girls were A. Two 
failing grades were received by boys and none by girls. The 
marks of the youth who had graduated were distinctly above 
the average.' 

Terman secured high-school grades for seventy-seven of the 
pupils who had been graduated. These marks are distinctly 
above those reported by Nettels and others for unselected high- 
school pupils as is shown in Table IV. 


TaBLE IV.—PeERcENTAGES OF A, B, C, D, anp E GRADES 
RECEIVED BY UNSELECTED AND BY GIFTED YOUTH 
REPORTED BY NETTELS AND BY TERMAN 
A, B, C, D, E, 

Per Cent————— Grapes MEAN 





Terman! gifted 


boys.......... 45 46 S 0.8 0.2 1,694 1.6 
Terman _ gifted 
te ne at's 73 = 24 S Gee cvs 1018 1.3 


Nettels,? —- unse- 
lected youth... 13 30 27 13.0 8.0 98,000 2.7 


1 Burks, Barbara S., Jensen, Dortha W., and Terman, Lewis M.: Genetic 
Studies of Genius, Stanford, California: Standford University Press, 1930, 


Vol. 111, pp. 101-103. 
? Nettels, C. H.: Educational Research Bulletin, Los Angeles Schools, Los 


Angeles, California: Los Angeles City Schools, 1929, Vol. vim, pp. 5-16. 


The gifted youth in Nettels’ study received A grades from four 
to eight times as frequently as the “‘unselected” or typical group. 
The gifted girls in Terman’s group received higher marks than 
the boys in every subject; and nine of the girls and only a few 
of the boys studied by Terman failed in any subjects.’ 

The grades in school subjects and the ranks in graduation 
classes were obtained for forty-two of the superior Negro youth 
included in the present study who were attending or who had 
graduated from two of the Chicago high schools: Englewood, 
which has a mixed Negro and white school population; and 
DuSable, where only Negro youth attend. Grade averages 





1 Witty, Paul A.: “‘A Genetic Study of Fifty Gifted Children,” op. cit., p. 


406. 
? Burks, Barbara S., Jensen, Dortha W., and Terman, Lewis M.: loc. cit. 
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were computed for the total number of semesters each pupil 
had been in high school. 

With the exception of two pupils, the mean high-school grades 
were above average. Of the nineteen youth for whom grade 
averages were available at DuSable High School, seven averaged 
E+, eight E and one E—, where E represents Excellent. The 
grade averages at Englewood were not as high as at DuSable. 
The mid-score of grade averages at Englewood fell between 2.75 
and 2.89 where 2.89 represents a rank of fifty-five in a graduating 
class of four hundred eighty-seven. The range is wide, but does 
not fall below 1.72, which closely approximates ‘‘Good.”’ 

Of the youth for whom ranks in graduation classes were avail- 
able, the range extended from third place in a class of two hundred 
twelve to one hundred fourteenth in a class of two hundred 
eighteen. With one exception every youth ranked in the upper 
fifth of his class at the time of graduation. 

The educational attainment of these Negro youth as measured 
by teachers’ grades and by rank in class is similar to that of 
superior white children studied by Terman and by Witty. 
Moreover, some of the Negro pupils were outstanding in their 
achievement. For example, one remarkable boy was graduated 
from the eighth grade at age ten years six months and from the 
University of Chicago at the age of sixteen. He was elected to 
Phi Beta Kappa; and he received the degree of doctor of phi- 
losophy at nineteen years of age. 

Parents’ Estimates of Children’s General Ability in 1940.—To 
supplement these data, parents’ estimates of their children’s 
general ability were secured through the use of questionnaires. 
Almost half of the parents believed their children were gaining 
in ability; and most of the others stated that these pupils were 
steady in their growth. The parents of two children indicated 
that losses were taking place. 


EDUCATIONAL INTERESTS AND AMBITIONS IN 1940 


To secure information concerning youth’s interest in high 
school and in college, questionnaires were used. Students were 
asked to state whether they enjoyed school very much, not 
very much, or if they preferred to quit school and get a job. 
Their responses are summarized in the following tabulation: 
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NUMBER 
ALL NuMBER NUMBER 
YouTuH Boys GIRLS 
WU 5 5 howe 00s sheared 68 17 51 
Not very much............. 4 1 3 
Would prefer to quit school 
and get a job?......... Yes 5 1 4 
No 48 14 34 


The responses of the youth were corroborated by these state- 
ments made by parents concerning the children’s degree of liking 
for school: 


DEGREE OF INTEREST NUMBER NUMBER NUMBER 
IN SCHOOL YoutTH Boys GIRLS 
Very strong........... 56(73 per 14(66 per 42(75 per 
cent) cent) cent) 
Fairly strong......... 18 6 12 
Slight liking.......... 2 1 l 
Positive dislike........ 1 0 1 
Number of youth... 77 21 56 


Liking for school was estimated by the parents’ response to a 
question which was phrased in a way exactly like that followed 
by Terman with the parents of gifted white children in 1921-1922 
and in 1927-1928. At the latter time, forty per cent of the boys 
and sixty-five per cent of the girls were said to have a very strong 
interest in school. The percentages for the Negro group are 
much higher. Only one Negro girl was said to dislike school 
thoroughly, and two were reported to show only a slight interest 
in and liking for school. All others were, it seems, strongly 
attracted to school. 

Preferences for certain school subjects were ascertained by 
having the youth designate their “liked” and ‘“‘disliked”’ 
subjects. Wide variety in favored subjects was indicated by 
the thirty-five different areas which were cited. The subject 
most frequently mentioned as a favorite was English. Science 
and chemistry followed, and French and history were ranked 
fourth and fifth, respectively. Twenty-two different subjects 
were included among those disliked. Eleven, ten, and nine 
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youth, respectively, indicated dislike for history, mathematics, 
and English. Three boys and seven girls reported they disliked 
no subject. Some of the school areas enjoyed most by the 
majority of youth were disliked by a minority; for example, 
seventy-eight votes were cast in favor of English and nine against 
it. None of these youth reported a distaste for science or 
chemistry. 

Terman! made an elaborate study of subject preferences by 
means of a ratio of the number of youth who liked a given subject 
to the number who disliked it. In his work with superior high- 
school and college youth he found that girls selected art, English, 
and modern languages, and rejected mathematics and civics; 
boys chose sciences and avoided ancient languages. The use 
of the ratio tends to make all subjects appear to be moderately 
well liked because the votes of rejection tend to cancel the votes 
of selection. For this reason, Terman’s results are not strictly 
comparable with the results of this study. But the trends in 
both studies are similar. 

Educational Guidance.—It is generally granted that students 
need guidance in the selection of a course of study in high school 
and in college. The extent to which these Negro youth received 
such assistance is suggested by the following tabulation of their 
responses to the question, ‘‘Has anyone given you definite help 
in selecting subjects?” 


NUMBER 

oF Boys Girits Tora. 
EE aE ee 11 26 37 
Ne ek elt 5 29 34 
Number of youth.............. 16 55 71 


According to these figures almost half of these youth received no 
guidance in selecting school subjects other than the limitation 
imposed upon them by the requirements for the diploma or a 
degree. 

Another question concerned the relationship to the youth of 
the persons who helped them. Parents, particularly the mothers, 
were mentioned as frequently as were the staff members of the 





1 Burks, Jensen, and Terman, op. cit., p. 112. 
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schools. The faculty advisor or homeroom teacher was the 
school person most likely to be sought for counsel. 

Educational Ambitions.—The parents were requested in the 
Home Information Blank to state: (1) whether the child desired 
to attend college, (2) if plans were being made and (3) whether 
the choice of college had been made. 

Seventy-three parents said their children wanted to go to 
college. Only one parent indicated that his son did not wish to 
attend. In fifty-six of seventy-four families, the children were 
already in college or were planning to attend in the near future. 
The decision as to the specific college had been reached in fifty- 
two cases. ‘Two families reported that no plans had been made 
as yet; and four indicated that inadequate funds made it impossi- 
ble to anticipate a four-year college course for their children. 
An additional twelve families offered no explanation but simply 
stated that no plans had been made. 

Interviews with eighty-three youth revealed that only one 
boy and one girl questioned seriously whether they would com- 
plete a four-year high-school course. The boy, at the time of 
the interview, was enrolled as a first-semester sophomore. He 
stated that he had been staying out of school to ‘“‘bum” and to 
sell cars. He remarked, “Perhaps I shall complete the high- 
school course sometime.” The girl left high school during her 
fourth year to attend a trade school; but she dropped out of 
school in May of the same year. Eighty-one of these eighty- 
three youth expected to complete or had already completed a 
four-year high-school course. 

Attendance in colleges or professional schools was greatly 
desired by these youth. To the question: ‘‘Do you expect to 
complete four years of college work?,” the majority of the boys 
and girls answered, ‘‘ Yes’’; a few hoped to do so; and a number 
replied that it would be impossible in spite of the fact that it 
was their desire. These responses were similar to those Terman 
secured when he questioned gifted white subjects. 


SUMMARY 


Two tests, the Myers-Ruch High-school Progress Test and 
the Iowa Every-pupil Test in Understanding of Contemporary 
Affairs, were administered in 1940 to eighty-two mentally 
superior Negro youth who had been identified in 1934 as having 
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Binet intelligence quotients ranging from 120 to 200. The test 
results were supplemented by information consisting of grades in 
subject-matter areas and ranks in graduation classes. By means 
of questionnaires, the parents were requested to estimate their 
children’s general ability and to enumerate their educational 
interests and ambitions. The youth were interviewed to secure 
additional information. The findings are summarized in the 
following paragraphs: 

(1) The educational attainment of these Negro youth as meas- 
ured by the Myers-Ruch High-school Progress Test, although 
above average, is not consonant with expectations based upon 
mental tests given in 1934. The median percentile rank of 
the group was 58.87, SD 24.2. The range, which is wide, extends 
from the thirteenth to the ninety-ninth percentile. Two pupils 
had percentile ranks of ninety-nine. Compared with other 
studies of gifted children the educational attainment of these 
Negro youth as measured by the Myers-Ruch Test is relatively 
low. 

(2) The mean percentile rank on the Iowa Every-pupil Test 
in Understanding of Contemporary Affairs was 53.7, SD 24.0: 
this, too, is slightly above the average. The range extends 
from the sixth to the ninety-seventh percentile. The high- 
school graduates and college youth in this group appear to have 
attained a better understanding of contemporary affairs than did 
white college freshmen and sophomores attending several 
teachers colleges. 

(3) In 1934, eighty-one per cent of these boys and girls were 
underage for their grade; the range of underageness extended 
from one-half year to three and one-half years. The under- 
ageness persisted in 1940. 

The percentile ranks on the two achievement tests were based 
on grade placement; not on chronological age. No allowance 
was made, therefore, for the acceleration in grade placements 
of these youth beyond their chronological ages. 

(4) The high-school grade averages of the forty-two youth 
who attended the DuSable and Englewood High Schools were, 
with only two exceptions, above the average. The range of 
grade averages for each child was wide but does not go below 
1.72 in any case; this rating approaches work described as 
“good.” 





Educational Attainment of Gifted Negroes 47 


Of the youth for whom ranks in high-school graduation classes 
were available all but one fell in the upper fifth of their classes. 
The exception ranked 114th in a class of two hundred eighteen. 

The educational attainment of these superior Negro youth as 
measured by teachers’ marks and rank in graduation class is 
similar to that reported for superior white boys and girls. 

(5) Parents described their children’s general ability in all but 
two cases as “gaining”’ or as “‘ holding his own.” 

(6) The Negro youth exhibited even stronger interest in school 
than did gifted white pupils. Only one pupil, a Negro girl, was 
said by her parents to dislike school thoroughly. Two were 
reported to show a slight interest in school. All others were, 
it seems, strongly attracted to their schools. 

(7) Interest in school subjects varied. Of thirty-five different 
areas mentioned, English was liked best. Science and chemistry 
followed; next in order came French and history. Only a few 
boys or girls reported that they disliked any subjects. Eleven, 
ten, and nine youth, respectively, expressed dislike for history, 
mathematics, and English. 

(8) Help in the selection of subjects or of a course of study was 
received by about half of these youth only. Parents were as 
active in this respect as were the members of the school staff. 

(9) All parents but one indicated that their children wanted 
to go to college. In fifty-six of seventy-three families the 
children already were in college or planned to attend. In many 
of the remaining cases, the family income was inadequate to 
provide a college education. 

Although this group of gifted Negroes does not appear to have 
entirely lived up to its early promise in educational achievement 
as measured by standardized tests, it does rank high when all 
criteria of attainment are considered. In terms of the meager 
opportunity of some of these youth, this fact is surprising and 


gratifying. 
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RELATION OF CHILDREN’S INTERESTS IN COMIC 
STRIPS TO THE —— OF THESE 
MICS 


GEORGE E. HILL 
Morningside College, Sioux City, Iowa 


Elsewhere a report has been made upon the interests of a group 
of fourth-, fifth-, and sixth-grade children in newspaper comic 
strips. The writer has also given an account? of the vocabulary 
of sixteen comic strips appearing on weekdays in daily papers. 
It is the purpose of this paper to present certain facts regarding 
the relation between children’s interests in these sixteen comics 


and the vocabulary of these strips. ~~. 


CHILDREN’S INTERESTS 


In our first study, two hundred fifty-six children in a public 
school in Philadelphia and a public school in suburban Upper 
Darby, Pennsylvania, were asked to list the five comic strips they 
“liked best.’”’ By simple numerical tabulation it was possible to 
rank the fifty-seven comics mentioned according to their popu- 
larity. The same children also checked the frequency with which 
they read these various comic strips. From the fifty-seven comics 
studied, sixteen were selected for an analysis of their vocabularies. 
These sixteen were selected so as to represent a substantial range 
of interest. 

In Table I we have arranged the sixteen comics according to 
their rank in “popularity”? and “frequency of reading.’”’ The 
rankings refer only to the standing of these sixteen comics in 
relation to each other, and distort somewhat their popularity as 
compared with the many other comics these children read. For 
example, ‘‘ Dixie Dugan”’ was about the least popular of fifty- 
seven comics among boys. It is still the least popular of these 
sixteen, of course; but, its difference in rank as compared with 
‘Dick Tracy” is much less than if all fifty-seven comics had been 





1 Hill, George E. and Trent, M. Estelle: ‘Children’s Interests in Comic 
Strips,” Journal of Educational Research, Vol. xxtv, September, 1940, pp. 


30-36. 
2 To be published in a forthcoming issue of The Journal of Educational 


Psychology. 
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TABLE I.—RANK oF SIXTEEN Comics IN POPULARITY 
AND FREQUENCY OF READING 



















ait tes Rank in 
‘ , Popularity Frequency of 
Comic Strip Reading 

Boys} Girls} All| Boys} Girls} All 

ih. GI GS ok nov cb dares 1 1; l| 3 5} 3 

a Se ee 2 2; 2 2 8}; 5 

3. Popeye (Thimble Theatre) . 3 6; 3} 4 3| 2 

4. Tarsan...... 4 12; 5 6); 16; 10 

5. Mickey M 5 4; 4 5 l l 

6. Joe yy si oF Ba). See 

RR Ee pee 7 10; 9 7 6 6 

8. Hairbreadth Harry........ 8 Ti Ot es 

9. Tailspin Tommy.......... 9; 15] 13) 14] 15] 16 

10. Terry and the Pirates...... 10; 13/12) 10; 13) 11 
11. Jiggs (Bringing up Father).| 11 8; 10) 9 4| 7 
sc ns Sanatencdass 12 3; 6 12 2; 8 
13. Skeesix (Gasoline Alley)....| 13 | 16] 16} 11 14 | 14 
14. Winnie Winkle............| 14 11 | 14; 15 9| 12 
15. Orphan Annie............. 15} 14/15 13] 12) 13 
ee 16 5/11) 16] 10] 15 























included in the vocabulary study. Probably, if all fifty-seven 
comics had been included, the correlation coefficients would have 
tended to be larger than they are. 


VOCABULARY OF THE COMICS 


All words used in these sixteen comics for four full weeks 
scattered evenly through the year were counted. Not counting 
such meaningful symbols as ##, !!!, *** and the like, 9302 differ- 
ent words and 28,808 words in all were used. These words were 
classified into the following categories: 

(1) Those in Gates’ A Reading Vocabulary for the Primary 
Grades, Revised and Enlarged. 
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(2) Those in Thorndike’s, Teachers Word Book of 20,000 Words 
by 500’s for the first five thousand, and by thousands for the 
remaining fifteen thousand. 

(3) Words not appearing in either the Gates nor the Thorndike 
lists. 

(4) Slang. 

(5) Misspelled words. 

(6) Onomatopoeia. 

(7) Foreign words. 

It was found that the vocabulary of these comics was selected 
mainly from the easier categories. Seventy-eight per cent of all 
words used were in the Gates list, seventy-nine per cent were from 
the first two thousand of the Thorndike list. Only 2.4 per cent 
were in neither list. Only one per cent of all words were slang. 

To suggest ease of vocabulary it was decided to use the per- 
centages of words used in each comic that came from the following 
categories: 

(1) Percentage of different words from the first five hundred of 
Thorndike. 

(2) Percentage of all words from the first five hundred of 
Thorndike. 

(3) Percentage of different words from the first two thousand 
of Thorndike. 

(4) Percentage of all words from the first two thousand of 
Thorndike. 

(5) Percentage of all words not in the lists. 

To arrive at some rough measure of difference among the six- 
teen comics with respect to these variables, the comics were 
ranked from 1 to 16, rank of ‘‘1”’ being assigned to the comic that 

had the largest percentage of words from the particular category 
in question. These ranks were then compared with the comics’ 
ranks in respect to popularity and extent of reading. 


RELATION OF INTEREST AND VOCABULARY 


The coefficients of correlation in Table II are all rank corre- 
lations, rho. The reader will do well to keep in mind that, with 
respect to the first five variables in the vertical column, a rank 
of ‘“‘1” tends to suggest the easiest vocabulary, while a rank of 
“1”? in popularity or extent read means the most popular or 
most read. 
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TABLE I].—CorRRELATIONS OF POPULARITY AND EXTENT OF 
READING WITH VOCABULARY CLASSIFICATIONS (RHO) * 

















Rank of Comics as to 
Rank of Comics as to Popularity Extent Read 
Boys | Girls | All | Boys | Girls; All 

1. Per cent of diff. words from | — 315) + .328/+ .019| — .255|+ .321| — .072 
first 500 of Thorndike list | + . 152) + . 150) + . 168) + . 158] + .151) + . 167 

2. Per cent of all words from |— _507|+.011|— .177| — .426| + .093| — .232 
first 500 of Thorndike list.| + . 105) + . 169] + . 163) + .138| + .167| + .159 

3. Per cent of diff. words from | — 217) + .227/+ .008/ — - 219) + .230) — .041 
first 2000 of Thorndike list.) + 161) + . 160) + . 169) + .161| + .159| + .168 

4. Per cent of all words from | — _382)+ .225| — .064| — .344/+ .289| — .081 
first 2000 of Thorndike | + .144/+ .160)+.168) + . 148) + .155) + . 167 
list. 

5. Per cent of all words not |+ . 239) —.040|+.156/+ .454/+ .241|+ .406 
found in the word lists | + . 158) + .163) + .164) + .133) + .158)+.141 
used. 

6. Per cent of different words |+ .113)+.174/+.118|+.325| + .180)+ .323 
that were slang. + .166| + . 163) + . 166) + .150) + . 163) + .151 

7. Per cent of all words that |+ .296|+ .190)+ .275/+ .432| + .159|+ .381 
were slang. + .154) + . 162) + . 155) + .137| + . 163) + .143 

8. Per cent of all words that |+ .314|+.193)+ .262/+ .486/+ .156|+ .486 
were slang, misspelled, | + .152)+.162)+.155) + .129) + .164)+.129 
onomatopoeia, etc. 























1— p> 
J/N 

The facts which may be gathered from these correlations might 
be summarized as follows: 

(1) None of the coefficients are large. Of the forty-eight coeffi- 
cients, only one is greater than .500 and only seven are greater 
than .400. Apparently differences in vocabulary are not closely 
related either to the popularity of these comics nor to the extent 
to which they were read by the fourth-, fifth-, and sixth-grade 
children questioned. 

(2) While the coefficients are small, there is a very consistent 
difference between the relation of interest and vocabulary among 
boys as against girls. So far as these sixteen comics are con- 
cerned, the boys seemed to prefer the ones with more difficult 
vocabulary, while the girls tended to prefer the comics with the 
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easier vocabulary. One would not be warranted in concluding 
that this is true of all children or of all comics. The consistency 
of this difference, when five measures of vocabulary difficulty 
were used, is more impressive than the actual size of the coeffi- 
cients of correlation. 

(3) There is a slight tendency for these children to prefer those 
of the sixteen comics that employed the greater proportion of 
such word forms as slang, misspelled words, and onomatopoeia. 
The correlation, while not large, is consistently positive between 
extent of preference for comics and proportion of words that were 
of these forms. 


INDIVIDUAL ANALYSIS OF COMICS 


Correlation of our measures of vocabulary difficulty and of 
children’s preferences involves certain obvious limitations. Some 
of these have already been mentioned. Probably one of the most 
serious of these limitations is the fact that thestudy of preferences 
was limited to a relatively small number of children in the upper 
elementary grades. There is good reason to believe that such 
comics as Winnie Winkle, Orphan Annie, Gasoline Alley, and 
Terry and the Pirates are produced primarily for an audience 
considerably older than the children we questioned. 

The analysis presented in Table III may help to bring out cer- 
tain facts not so clearly revealed by the type of relationships 
revealed by correlation. 

The classification of comics as to ‘‘type’”’ is based on sugges- 
tions made by Gay.' The classification as to preference is based 
upon the rankings foundin TableI. The difficulty of vocabulary 
and use of unusual words was based on a rather arbitrary judg- 
ment arrived at after considering the percentages of words in 
each comic that are found in the Gates list and in the first two 
thousand of the Throndike list. 

It is apparent that children’s preference for certain comics 
bears no close relation to the difficulty of their vocabulary. Nor 
is there any apparent relation between type of comic and diffi- 
culty of vocabulary. As would be expected, the comics of 
“burlesque” type tend to be above average in their use of slang 
and other distorted word forms. 





1Gay, Roger C.: “A Teacher Reads the Comics,” Harvard Educational 
Review, Vol. vu, March, 1937, pp. 198-209. 
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SUMMARY 


(1) The preferences of children in the fourth, fifth, and sixth 
grades for sixteen comic strips have been compared with the 
vocabulary of these comics. 

(2) There is no substantial relationship between vocabulary 
load and children’s preferences for certain comics, so far as the 
sixteen comics studied and the children questioned were concerned. 

(3) There was a slight but consistent tendency for girls to 
prefer those of the sixteen comics that had easier vocabulary and 
a slight but consistent tendency for the boys to prefer those of 
more difficult vocabulary. This difference is apparently an out- 
growth of differences between girls and boys in preference for 
certain types of comics. Apparently boys prefer certain comics, 
and girls prefer others, irrespective of vocabulary. Also, it 
should be noted that the differences in difficulty of vocabulary 
among the various comics were not great. 

(4) There is a slight tendency for children to prefer the comics 
that employ the greater amount of slang and other distortions. 
The amount of such usage was not, however, great in proportion 
to total vocabulary, since only 5.4 per cent of all words used were 
slang, missvelled, or onomatopoeia. 

(5) There is no relation between type of comic and its vocabu- 
lary, as here measured, except that ‘‘burlesque”’ comics tend to 
use more distorted word forms. 








THE APPRAISAL OF READING COMPREHENSION 


A. 8. ARTLEY 


Stephens College, Columbia., Mo. 


In any plan for reading instruction, appraisal of ability as a 
means of discovering specific needs and of determining growth 
is an integral part of the program. However, unlike the engineer 
and the chemist who have well-defined, reliable, and valid 
measuring scales, the educator is materially handicapped in his 
measurements because of certain limitations in existing reading 
tests. Their limitations are present largely as the result of an 
inadequate understanding of the functions being appraised by 
these tests. Fortunately, however, a number of recent researches 
are furnishing the basis for more thorough understanding of 
the skills involved in the reading act. 

With only a few exceptions reading comprehension in the past 
was considered an undifferentiated ability. Hence, it was 
assumed that the factors that made for successful comprehension 
in one area of instruction were the same as those that entered 
into adequate understanding and evaluation in another. Put 
in another way, reading comprehension was considered largely 
as being made up of general factors common to a number of 
content areas. On this basis the reader who comprehends well 
in one area of instruction should be able to comprehend similarly 
in another. This concept of reading comprehension has been 
seriously challenged by a number of researches. 

Gans‘ attempted to determine whether a critical type of 
reading comprehension was related to the type measured by the 
ordinary test of reading comprehension. Critical reading 
comprehension was defined as the type necessary in a functional 
reading situation where solving a problem in the social studies 
would require a selection and rejection of content. Using con- 
ventional tests of reading comprehension and an author-con- 
structed test of critical reading involving selection-rejection 
factors, Gans found that the correlations between the two types 
ranged from —.09 to .51. On the basis of these data she con- 
cludes that “ ... the factors which enter into the critical 
selection of remotely relevant paragraphs differ so widely from 
those functioning in general reading that practically no relation- 
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ship exists between skill in the use of one kind of reading and the 
skill in the other.”’ 

Grimm! challenged the assumption that the abilities employed 
in securing information as measured by the subtest on reading 
interpretation found in the Progressive Achievement Test were 
related to those involved in meeting the more intangible edu- 
cational objectives as found in the social studies. Such abilities 
were those of interpreting data, applying principles, and analyz- 
ing propaganda. Grimm found that the relationships between 
the test of general reading comprehension and the test of the 
specialized abilities in the social studies ranged from .51 to .66. 
“Hence, it would seem,” Grimm writes, “that reading ability 
and the ability to interpret data are somewhat related in the 
social studies, but not definitely enough to consider them a single 
behavior.”’ 

Shores® and Swenson’ studied the problem of the interrelation- 
ship between the general and specific factors in reading compre- 
hension in the fields of social studies and science, respectively. 
Comparisons were made between the means of matched groups, 
appraised in their ability to read materials in the several content 
fields. Both found that the ability to read one type of material 
was related to the ability to read another type, but Shores adds 
that, ‘‘Relatively constant differences between the critical ratios 
of the groups divided with respect to the history and Traxler 
reading scores may show that, even though closely related, each 
of these reading materials has individual peculiarities.”’ 

Artley! studied the relation between the general and specific 
factors involved in reading comprehension in the area of the 
social studies. He found a correlation of .79 between general 
reading comprehension as measured by the Codperative Test of 
Reading Comprehension and reading comprehension in the social 
studies as appraised by a composite test composed of the Pro- 
gressive Education Association Application of Principles in the 
Social Studies and the Coéperative Test of Social Studies Abilities. 
Regarding this relationship he writes as follows: ‘““One may 
conclude that though the correlation between scores on the two 
factors is sufficient to say that a high degree of commonality 
exists between them, it is not high enough to dismiss the possi- 
bility that there are a great number of pupils in the distribution 
who might profit from a specific type of instruction.” 











The Appraisal of Reading Comprehension 57 


These researches lead to the conclusion that reading compre- 
hension is comprised of both general and specific factors. If this 
conclusion be true, then comprehension in each area becomes 
specific to the extent to which those specific factors exist. There 
is, in addition, ample evidence to show that the reading skills 
and abilities that make up both the general and specific factors 
in reading comprehension possess only a nominal amount of 
commonality. 

Elden Bond? found, for example, in a study which dealt in 
part with the intercorrelations among several study skills (loca- 
tion of information, map-graph reading, and knowledge of 
current periodicals) that the correlations ranged from .31 to .48. 

Gans‘ had occasion in her study to determine the correlations 
among the abilities necessary to read five different types of para- 
graphs involved in critical evaluation. She found the inter- 
correlations between the several types of reading to run between 
—.04 and .77 with a preponderance of the correlations under .60. 
This indicates that the several abilities exist in varying degrees 
of independence, one from the other. 

Tyler® investigated the relationship between an unnamed test 
covering zoological information and a test purporting to appraise 
the ability to infer, and found it to be .29. ‘“‘If the ability to 
propose inferences is an important objective of zoology,” he 
opines, “‘we must have a measure for it, for we cannot depend 
upon the information tests to indicate the students’ attainments 
of this objective.” 

Dewey,’ in a similar study, undertook to see whether the 
ability to secure facts was related to the ability to do an infer- 
ential type of thinking on history type material. The correla- 
tions ranged, depending upon the grade, between .382 and .652. 
Very pointedly he concludes: “we can no longer assume that by 
making factual tests of reading, we have at the same time meas- 
ured true understanding of what is read.” 

Artlcy,' in the study mentioned previously, shows the inter- 
correlations existing among measures of the several factors 
presumed to be components of reading comprehension in the 
social studies. The abilities to obtain facts, to organize, to 
interpret, and to apply generalizations were appraised by the 
Codperative Test of Social Studies Abilities. The abilities to 
perceive logical relations and to evaluate arguments were meas- 
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ured by the Progressive Education Association’s Application of 
Principles in the Social Studies; while general reading vocabulary 
and social studies vocabulary were subtests of the Codperative 
Test of Reading Comprehension, Cl, and the Coédperative Test of 
General Proficiency in the Field of Social Studies, respectively. 
These tests were administered by the author to two hundred 
high-school juniors. 

The data relating to the intercorrelations among the several 
subtests are shown in Table I. 


TABLE I.—INTERCORRELATION BETWEEN MEASURES OF THE 
SEVERAL Factors PRESUMED TO BE COMPONENTS OF 
READING COMPREHENSION IN THE SociAL STUDIES 


(N = 200) 

FAacToRS 1 2 3 4 5 6 7 8 
1. Ability to Ob- 

tain Facts... .... .400 .471 .523 .367 .351 .484 .499 
2. Ability to Or- 

ganize....... .... .... .600 .499 .4383 .309 .608 .608 
3. Ability to Inter- 

ale eee late sess ica’ Ge ee ee ee Cue 


4. Ability to Ap- 

ply Generali- 

zations...... sees ‘wore swe eens Ge Cue cee Cae 
5. Ability to Per- 

ceive Logical 

ooh kes Whale aeew wane. Sa ee Saeeee 
6. Ability to Eval- 

uate Argu- 

ments....... eck eae Saat dave 406 Bone ee ee 
7. Command of 

General 

Reading Vo- 

PLC. cece tyie Kove baba See aeten sve Ge 
8. Command _ of . 

Social Studies 

Vocabulary. . 


It will be observed that the correlations extend between .275 
and .785 with only several over .60. It is interesting to note 
that the higher correlations exist between the measures of general 
and specific vocabulary and the other factors. However, the 
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chief feature to be observed here is the positive though moder- 
ately low relationship between the measures of the several com- 
ponents presumed to be factors of reading comprehension in the 
social studies. In other words, though the factors are positively 
related, possessing the ability to organize, for example, does not 
necessarily infer a high degree of ability to perceive logical 
relations or to evaluate arguments as measured by the tests used. 

The general conclusion that seems tenable on the basis of the 
findings from these studies is that the factors inherent in general 
and specific reading comprehension, though for the most part 
related, are not correlated to a sufficient degree to be able to 
say that the ability to engage successfully in one type of reading 
is by the same token related to the ability to engage successfully 
in another type, or that the command of one particular reading 
skill is by virtue of that fact related to another. 

For the test maker and the test user this conclusion has par- 
ticular significance. First, it makes it appear that an adequate 
test of reading comprehension should be one that requires a 
number of different types of responses. That is, the test should 
appraise a number of different abilities rather than only one or 
several as is the practice in many present tests. For example, 
in a survey-type test such abilities as the following should be 
evaluated: ability to infer, ability to organize, ability to select 
the main idea in a paragraph or longer selection, ability to select 
important details, ability to judge the relevancy of material, 
ability to determine the meanings of words in contextual settings, 
ability to interpret, ability to sense the mood, tone, and intent 
expressed by the writer, ability to generalize, etc. It is apparent 
that such an appraisal is an attempt to get at the thinking side 
of reading—a consideration receiving much recognition by those 
who are concerned with semantic implications. 

In the second place, these researches point out the need for 
reading tests placing more emphasis upon diagnosis. It is not 
enough to say that a pupil comprehends thus and so in general, 
but rather, that he comprehends well or poorly in history, 
literature, or algebra. Such a demand necessitates a delineation 
of the reading purposes or abilities essential for adequate com- 
prehension in each area of experience, and then the construction 
of tests or subtests that will appraise growth and achievement 
in these specific abilities. Knowing, for example, that adequate 
comprehension in history requires the abilities, among others, 
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to secure information, to organize data, to interpret findings, 
and to understand the specialized terms and concepts, permits 
one to devise an instrument that will appraise strengths and 
weaknesses. These strengths and weaknesses can then be 
translated into pupil needs, which, in turn, furnish the basis 
for adequate instruction. 


SUMMARY 


Recent research in reading is throwing light upon the limita- 
tions of existing appraisal techniques in reading, as well as 
pointing the direction to definite means of improving them. 
Two needs seem paramount: first, the need for reading survey 
tests that require a number of different types of responses— 
particularly those responses placing a premium upon the thinking 
side of reading; second, a need for tests that are sufficiently 
diagnostic to be able to delineate reading needs in the several 
instructional fields. 
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BOOK REVIEWS 


Max C. Otro anp OrHers. William James, the Man and the 
Thinker. Madison, Wis.: University of Wisconsin Press, 


1942, pp. 147. 


The lecture in this series which will be of especial interest 
to psychologists was delivered by Norman Cameron and entitled, 
‘‘William James and Psychoanalysis.” James’ direct influence 
on the content of the lecture was slight. As Cameron states, 
James, despite his interest in the esoteric and his own numerous 
personal adjustment problems, nowhere summarized his thinking 
on abnormal psychology. He was in his middle sixties when 
Freudian theories established their first important beachhead 
(sic. p. 63) on American soil in 1909. Despite their newness 
and rationalistic spirit, however, James looked more kindly upon 
the promise of Freud’s ideas than does Cameron. The latter’s 
lecture is devoted almost entirely to a vigorous attack upon 
the sterility of psychoanalysis and its absolutistic and dogmatic 
rationale. For example (p. 68f): 

“When the fragmentary data of conscious experience refuse 
to fit the preconceived scheme, they are subjected to Procrustean 
alterations until they do. When they flatly contradict the 
demands of this psychic theory, they are declared to symbolize 
the direct opposite of what they seem to mean. In this way the 
hypotheses always win, the facts only if they conform.” .. . 
“From the point of view of the history of scientific thought, 
this whole scheme represents progress in reverse. It is intellec- 
tual atavism.” 

Many psychoanalysts will not like these statements, but the 
reviewer did. Much that the analysts do has therapeutic 
validity, but their mystical terminology and their “‘cult”’ 
loyalties are obstacles to maximum effectiveness. This is 
realized apparently by psycho-therapists like Carl Rogers who 
are making available techniques which do not involve such 
sweeping theoretical commitments. 

Other lectures in the monograph are, “The Distinctive 
Philosophy of William James,” by Max C. Otto; “ William 
James, Man and Philosopher,” by Dickinson S. Miller; “‘ William 


James and the World Today,” by John Dewey; “ William James 
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in the American Tradition,” by Boyd H. Bode; and “William 
James as a Religious Thinker,” by J. Seelye Bixler. 
University of Chicago. STEPHEN M. Corey. 


Eleventh Annual Conference on Delinquency Prevention. Spon- 
sored by the Division for Delinquency Prevention in 
Coéperation with The Big Brothers and Sisters Association 
of Illinois. Springfield, Ill.: Department of Public Welfare, 
1942, pp. 222. 


This volume presents a series of discussions about the reper- 
cussions of the war situation on the behavior patterns of young 
America. Participating in the conference are psychologists, 
physicians, churchmen, educators, and public welfare officials. 
Topics covered are: (1) Reactions of youth in our present crisis, 
(2) Meeting the problems of youth through community planning 
and projects, (3) Problems of youth in time of war, (4) Education 
problems in our present crisis, (5) Delinquency—its challenge 
to religion, (6) Meeting the problems of delinquency prevention 
in our present crisis in Illinois, (7) The Big Brothers and Sisters 
Association, and (8) Youth looks for leadership in our present 
crisis. 

The keynote sounded throughout the conference is the fact 
that the increasing rate of neurosis and delinquency in these 
times presents a remarkable “opportunity for overcoming the 
self-centered viewpoint that life is a process of exploitation and 
substituting the experience that the full life is one of contribu- 
tion.’”’ The stresses which pervade our democracy today con- 
stitute as real a threat to its existence as the onslaughts from 
without, and only as we can help adapt our youth to the ever- 
increasing burden of its needs can we hope for a better future in 
America. LEONARD S. Koaan. 

University of Rochester. 


Leta S. Hoxtirneworts. Children Above 180 JQ. Yonkers- 
on-Hudson: World Book Co., 1942, pp. 332. 


Problems of social and educational adjustment of children 
with rare mental endowment have been neglected too frequently. 
These problems have been brought into clear focus in this trea- 
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tise published posthumously with the addition of certain editorial 
supplements by Dr. H. D. Hollingworth. 

The first section, concerned with orientation to the subject- 
matter, deals with the concept of intellectual genius, the early 
study of eminent adults, and published reports of tested children. 
Reports on twelve new cases are given in the second section. 
The two chapters summarizing these new cases were written 
by Dr. H. L. Hollingworth. The third section was to have 
dealt ‘“‘with general principles and with social and educational 
implications of the study of children of very high intelligence.”’ 
Since this had not been written, the chapters are made up of 
relevant material selected from the author’s previously published 
papers. 

Children with I1Q’s higher than 180 are rare. The author 
found only twelve cases in twenty-three years’ seeking in New 
York City. These children are more than plus 7 PE away from 
the norm. Only one to three occur in every million children 
born in the United States. The author states that the earlier 
suggestion that 140 IQ represents ‘‘genius or near-genius’’ was 
premature. She considers that the point at which the term 
“genius” begins to apply is at or near IQ 180 if we adhere to 
the dictionary definition of the word. 

The case histories are detailed and fairly complete. Remote 
ancestors of children above 180 IQ were fairly successful, most 
of the fathers are in professions, and IQ’s of siblings are above 
130. Age of talking (fourteen months) and of reading (three 
years) clearly differentiated the 180 IQ group from normals. 
Physique and health of the bright children are generally good. 

Of special interest are the difficulties of social and educational 
adjustments, which were numerous among children above 180 
IQ. Social dislocation is apt to occur when a very gifted child 
is placed in school grades with children much older then he. 
They seldom find companions who are able to understand them. 
They tend to develop negativisim, to play by themselves, to 
turn to imaginary playmates, and to acquire feelings of inferi- 
ority. It is pointed out, however, that children of 125 to 155 
IQ tend to adjust satisfactorily to their environment. But if a 
child tests above 170 IQ there is likely to be difficulty. 

“Children at or above 180 IQ . . . are likely to regard school 
with indifference, or with positive distaste, for they find nothing 
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interesting to do there.’”’ In some cases truancy develops. 
Regular teachers tend to be decidedly unsympathetic; in fact, 
the ordinary teacher is incapable of either understanding or 
stimulating these very bright children. 

On the basis of her broad experience with gifted children and 
in the experimental classes for ‘‘rapid learners’’ which she 
organized at the Speyer School, the author outlines educational 
practices suitable for very bright children. Best adaptation 
occurs when the gifted child is identified early and becomes a 
member of an experimental group made up of others like him. 

The contributions of Dr. Leta 8S. Hollingworth in this field are 
of lasting value. It is gratifying to have this collection of papers 
made available to workers in the field of individual differences. 

Mives A. TINKER. 
University of Minnesota. 
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